-- Logs begin at Tue 2022-08-02 20:40:23 UTC, end at Tue 2022-08-02 22:04:29 UTC. -- Aug 02 21:31:03.679643 dv-cinder-851449-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 21:31:03.689059 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 21:31:03 2022] *** Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: nodename: dv-cinder-851449-4-iscsi Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: machine: x86_64 Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: clock source: unix Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: pcre jit disabled Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: detected number of CPU cores: 4 Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: current working directory: / Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: detected binary path: /usr/bin/uwsgi-core Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: your processes number limit is 47680 Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: your memory page size is 4096 bytes Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: detected max file descriptor number: 2048 Aug 02 21:31:03.691046 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: lock engine: pthread robust mutexes Aug 02 21:31:03.692563 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: thunder lock: enabled Aug 02 21:31:03.692563 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 21:31:03.692563 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 21:31:03.731055 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: Python main interpreter initialized at 0x55e14fad99c0 Aug 02 21:31:03.731055 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: python threads support enabled Aug 02 21:31:03.731055 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: your server socket listen backlog is limited to 100 connections Aug 02 21:31:03.731055 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: your mercy for graceful operations on workers is 90 seconds Aug 02 21:31:03.731361 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 21:31:03.731435 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: *** Operational MODE: preforking *** Aug 02 21:31:03.731668 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: *** uWSGI is running in multiple interpreter mode *** Aug 02 21:31:03.731668 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: spawned uWSGI master process (pid: 105134) Aug 02 21:31:03.731871 dv-cinder-851449-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 21:31:03.732643 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: spawned uWSGI worker 1 (pid: 105135, cores: 1) Aug 02 21:31:03.732750 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: spawned uWSGI worker 2 (pid: 105136, cores: 1) Aug 02 21:31:03.732922 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 21:31:04.386374 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 21:31:04.393275 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 21:31:05.492628 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:31:05.492628 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: from cryptography.utils import int_from_bytes Aug 02 21:31:05.493205 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:31:05.493205 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: from cryptography.utils import int_from_bytes Aug 02 21:31:05.497662 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:31:05.497662 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: from cryptography.utils import int_from_bytes Aug 02 21:31:05.498076 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:31:05.498076 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: from cryptography.utils import int_from_bytes Aug 02 21:31:07.971426 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 21:31:07.972053 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 21:31:07.972214 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 21:31:07.973209 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 21:31:07.973306 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 21:31:07.973393 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 21:31:07.973393 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 21:31:07.973543 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 21:31:07.973764 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.973903 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 21:31:07.974095 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.974186 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 21:31:07.974422 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.974538 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.974746 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.974848 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.975081 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.975174 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.975398 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.975489 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.975723 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.975815 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.976044 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.976172 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.976399 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.976502 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.976663 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.976755 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.976983 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.977067 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.977296 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.977393 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-4-iscsi {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.977610 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978040 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978040 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978173 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-4-iscsi {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978247 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978312 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978529 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978633 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978836 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.978928 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.979151 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.979249 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.979457 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.979541 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.979777 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.979962 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.980073 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.980430 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.980602 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.980735 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.980917 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.981051 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.981225 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.981383 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.981537 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.981670 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.981874 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.981983 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.982189 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.982280 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.982498 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.982595 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.982819 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.982916 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.983128 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.983229 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.983449 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.983620 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-4-iscsi {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.983758 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.983894 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.984182 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-4-iscsi {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.984273 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.984503 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.984598 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.984820 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.984937 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.985134 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.985237 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.985544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.985624 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.985854 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.985941 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.986165 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.986249 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.986484 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.986585 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.986807 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.986894 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.987118 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.987211 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.987439 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.987531 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.987756 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.987885 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.988061 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.988167 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.988419 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.988517 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.988729 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.988824 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.989041 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.989127 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.989347 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.989441 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.989657 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.989742 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.989916 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.990005 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.990229 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.990314 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.990488 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.990580 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.990796 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.990881 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.991119 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.991206 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.991413 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.991501 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.991666 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.991762 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.991988 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.992072 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.992262 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.992365 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.992584 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.992678 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.992902 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.992996 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.993213 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.993310 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.993522 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.993620 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.993829 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.993926 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.994136 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.994226 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.994442 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.994534 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.994748 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.994840 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.995053 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.995144 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.995361 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.995448 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.995679 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.995771 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.995987 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.996078 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.996331 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.996461 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.996644 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.996728 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.996964 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.997065 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.997273 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.997364 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.997598 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.997682 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.997908 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.998005 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.998220 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.998311 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.998546 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.998633 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.998854 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.998947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.999167 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.999250 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.999476 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.999569 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.999782 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:07.999878 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.000090 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.000250 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.000421 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.000519 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.000739 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.000832 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.000991 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.001075 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.001296 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.001384 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.001603 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.001688 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.001907 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.001995 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.002214 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.002300 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.002520 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.002605 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.002827 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.002911 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.003129 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.003213 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.003434 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.003527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.003734 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.004337 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.004580 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.004894 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.005201 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.005492 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.005588 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.005804 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.005888 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.006110 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.006197 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.006417 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.006503 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.006738 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.006823 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.007052 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.007137 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.007359 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.007442 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.007669 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.007759 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.007976 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.008116 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.008309 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.008397 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.008633 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.008718 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.008944 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.009036 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.009251 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.009334 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.009566 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.009735 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.009876 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.009961 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.010190 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.010276 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.010501 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.010586 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.010812 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.010897 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.011124 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.011209 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.011435 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.011521 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.011740 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.011832 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.012051 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.012161 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.012398 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.012512 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.012708 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.012799 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.013015 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.013113 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.013320 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.013423 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.013657 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.014091 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.014193 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.014411 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.014724 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.014825 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.015037 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.015265 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.015363 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.015641 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.015803 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.015964 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.016321 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.016424 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.016638 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.016904 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.016992 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.017243 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.017453 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.017564 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.017906 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.017999 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.018241 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.018489 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.018576 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.018849 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.018946 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.019142 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.019264 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.020285 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.020386 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.020617 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.020707 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.020942 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.021206 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.021284 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.021670 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.021768 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.021992 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.022130 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:31:08.022310 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.022500 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.022889 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.023082 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.023215 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.023438 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.023534 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.023762 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.023844 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.024104 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.024242 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.024469 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.024564 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.024800 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.024896 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.025115 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.025199 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.025435 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.025541 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.025764 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.025850 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.026083 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.026168 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.026396 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.026480 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.026711 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.026796 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.027035 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.027128 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.027361 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.027447 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.027687 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.027779 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.028009 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.028119 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.028331 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.028413 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.028650 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.028736 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.028965 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.029064 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.029304 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.029427 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.029620 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.029705 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.029936 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.030030 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.030256 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.030341 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.030570 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.030661 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.030891 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.030987 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.031206 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.031292 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.031521 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.031606 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.031837 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.031934 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.032193 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.032281 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.032510 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.032606 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.032826 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.032913 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.033144 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.033259 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.033469 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.033567 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.033784 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.033877 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.034095 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.034188 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.034410 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.034514 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.034721 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.034818 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.035044 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.035151 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.035361 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.035462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.035675 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.035776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.035980 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.036073 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.036329 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.036436 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.036655 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.036759 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.036966 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.037058 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.037283 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.037390 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.037598 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.037692 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.037912 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.038003 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.038222 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.038343 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.038528 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.038622 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.038836 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.038937 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.039142 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.039243 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.039453 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.039554 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.039759 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.039851 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.040086 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.040228 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.040425 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.040519 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.040734 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.040837 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.041062 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.041163 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.041367 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.041459 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.041674 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.041783 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.041984 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.042077 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.042296 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.042388 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.042600 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.042693 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.042913 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.043007 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.043225 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.043322 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.043529 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.043628 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.043853 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.043943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.044183 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.044275 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.044494 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.044596 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.044818 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.044916 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.045125 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.045222 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.045433 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.045531 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.045750 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.045846 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.046063 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.046152 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.046369 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.046469 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.046683 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.046774 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.047052 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.047147 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.047295 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.047390 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.047595 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.047684 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.047907 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.047996 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.048235 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.048342 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.048547 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.048646 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.048904 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.048996 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.049164 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.049259 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.049472 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.049571 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.049799 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.049890 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.050109 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.050197 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.050414 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.050503 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.050743 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.050840 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.051050 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.051147 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.051357 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.051446 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.051668 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.051766 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.051974 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.052063 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.052302 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.052391 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.052611 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.052717 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.052918 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.053008 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.053223 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.053327 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.053547 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.053649 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.053858 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.053947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.054162 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.054252 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.054467 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.054558 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.054772 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.054862 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.055112 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.055201 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.055421 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.055565 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.055739 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.055880 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.056055 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.056235 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.056406 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.056559 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.056723 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.056872 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.057035 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.057186 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.057331 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.057463 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.057647 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.057789 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.057960 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.058107 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.058275 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.058416 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.058589 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.058731 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.058912 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.059062 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.059226 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.059376 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.059542 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.059688 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.059845 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.059992 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.060170 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.060313 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.060480 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.060630 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.060801 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.060960 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.061095 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.061226 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.061408 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.061550 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.061734 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.061882 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.062047 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.062189 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.062434 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.062592 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.062747 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.062883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.063016 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.063148 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.063280 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.063412 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.063625 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.063774 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.063908 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.064039 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.064221 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.064365 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.064538 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.064696 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.064831 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.065009 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.065150 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.065283 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.065456 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.065598 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.065764 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.065904 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.066076 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.066214 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.066905 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.067059 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.067218 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.067366 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.067521 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.067668 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.067836 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.067989 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.068189 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.068336 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.068470 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.068619 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.068762 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.068896 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.069071 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.069219 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.069385 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.069539 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.069680 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.069814 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.069986 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.070135 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.070302 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.070460 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.070603 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.070743 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.070909 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.071066 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.071217 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.071362 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.071525 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.071672 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.071839 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.071981 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.072161 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.072318 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.072453 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.072584 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.072771 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.072912 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.073068 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.073202 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.073375 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.073516 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.073682 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.073821 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.073991 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.074131 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.074313 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.074454 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.074624 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.074775 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.074945 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.075097 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.075265 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.075412 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.075572 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.075725 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.075866 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.076005 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.076209 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.076352 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.076521 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.076671 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.076812 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.076956 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.077119 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.077260 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.077425 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.077580 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.077753 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.077892 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.078064 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.078212 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.078354 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.078488 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.078672 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.078813 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.078995 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.079143 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.079306 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.079447 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.079618 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.079758 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.079927 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.080066 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.080252 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.080389 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.080553 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.080695 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.080873 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.081026 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.081172 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.081462 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.081604 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.081772 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.081919 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.082640 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.082782 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.082970 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.083118 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.083296 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.083446 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.083605 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.083746 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.083941 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.084095 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.084295 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.084452 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.084637 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.084793 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.084942 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.085081 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.085253 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.085398 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.085552 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.085829 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.085988 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.086155 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.086300 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.086466 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.086615 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.086763 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.086903 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.087071 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.087219 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.087383 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.087543 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.087685 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.087835 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.087975 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.088113 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.088350 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.088508 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.088658 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.088883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.089025 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.089165 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.089304 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.089443 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.089594 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.089735 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.089884 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.090025 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.090163 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.090302 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.090449 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.090588 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.090727 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.090866 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.091005 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.091143 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.091291 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.091438 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.091588 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.091727 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.091897 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.092058 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.092243 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.092386 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.092526 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.092665 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.092838 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.092994 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.093135 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.093274 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.093444 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.093617 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.093757 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.093911 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.094052 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.094190 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.094358 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.094513 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.094653 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.094804 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.094944 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.095091 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.095279 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.095434 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.095590 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.095738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.095878 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.096025 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.096227 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.096385 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.096539 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.096680 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.096819 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.096964 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.097104 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.097244 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.097402 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.097566 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.097713 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.097852 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.097998 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.098146 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.098294 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.098449 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.098601 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.098741 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.098880 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.099027 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.099175 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.099332 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.099472 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.099611 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.099750 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.099897 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.100045 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.100205 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.100379 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.100527 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.100699 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.100862 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.101004 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.101143 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.101292 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.101431 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.101581 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.101733 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.101880 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.102020 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.102191 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.102347 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.102487 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.102635 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.102808 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.102957 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.103122 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.103280 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.103430 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.103578 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.103719 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.103865 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.104005 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.104181 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.104347 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.104490 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.104665 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.104815 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.104955 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.105101 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.105258 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.105407 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.105548 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.105697 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.105836 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.105983 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.106131 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.106271 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.106410 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.106550 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.106697 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.106845 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.106994 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.107144 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.107284 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.107430 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.107577 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.107725 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.107872 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.108012 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.108173 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.108331 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.108479 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.108646 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.108793 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.108955 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.109095 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.109234 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.109373 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.109521 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.109662 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.109808 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.109954 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.110101 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.110248 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.110388 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.110536 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.110676 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.110826 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.110973 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.111120 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.111261 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.111400 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.111539 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.111689 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.111830 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.111977 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.112127 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.112325 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.112477 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.112617 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.112767 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.112916 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.113057 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.113221 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.113372 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.113519 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.113666 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.113815 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.113962 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.114109 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.114273 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.114420 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.114568 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.114763 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.114912 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.115062 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.115203 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.115371 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.115531 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.115673 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.115812 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.115992 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.116167 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.116327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.116539 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.116681 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.116831 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.116971 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.117111 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.117259 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.117398 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.117537 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.117676 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.117815 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.117954 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.118102 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.118242 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.118411 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.118569 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.118734 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.118882 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.119125 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.119273 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.119413 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.119552 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.119691 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.119830 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.119981 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.120122 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.120297 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.120438 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.120588 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.120737 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.120886 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.121034 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.121197 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.121354 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.121495 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.121647 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.121787 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.121939 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.122079 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.122228 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.122392 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.122569 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.122712 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.122852 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.122990 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.123129 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.123298 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.123455 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.123596 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.123735 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.123906 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.124054 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.124255 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.124422 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.124571 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.124710 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.124850 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.124995 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.125143 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.125284 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.125447 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.125601 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.125742 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.125881 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.126032 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.126172 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.126342 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.126541 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.126689 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.126862 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.127018 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.127165 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.127366 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.127515 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.127680 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.127828 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.127976 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.128117 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.128292 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.128452 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.128594 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.128741 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.129476 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.129583 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.129726 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.129818 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.130042 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.130150 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.130349 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.130450 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.130710 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.130797 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.131035 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.131139 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.131372 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.131457 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.131685 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.131771 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.131993 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.132106 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.132323 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.132492 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.132636 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.132808 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.132960 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.133122 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.133265 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.133449 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.133569 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.133776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.133875 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.134103 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.134249 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.134414 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.134501 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.134731 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.134826 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.135043 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.135184 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.135370 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.135494 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.135697 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.135792 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.136011 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.136224 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.136345 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.136539 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.136647 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.136850 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.136972 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.137174 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.137296 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.137496 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.137611 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.137819 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.137928 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.138129 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.138339 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.138433 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.138664 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.138759 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.138978 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.139073 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.139303 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.139410 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.139632 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.139731 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.139939 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.140026 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.140268 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.140356 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.140585 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.140683 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.140894 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.141007 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.141204 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.141290 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.141523 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.141616 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.141834 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.141920 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.142152 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.142252 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.142464 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.142564 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.142777 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.142863 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.143087 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.143172 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.143395 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.143494 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.143720 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.143806 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.144026 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.144118 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.144355 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.144493 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.145204 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.145295 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.145529 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.145615 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.145837 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.145924 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.146149 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.146236 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.146461 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.146546 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.146772 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.146859 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.147078 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.147164 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.147381 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.147467 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.147961 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.148058 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.148295 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.148393 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.148619 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.148712 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.148933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.149028 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.149257 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.149344 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.149578 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.149737 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.149885 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.149972 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.150206 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.150292 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.150518 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.150613 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.150827 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.150912 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.151133 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.151218 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.151437 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.151532 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.151765 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.151851 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.152069 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.152210 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.152417 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.152516 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.152746 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.152840 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.153070 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.153154 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.153379 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.153465 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.153695 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.153787 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.154006 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.154092 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.154318 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.154443 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.154627 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.154721 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.154949 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.155035 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.155255 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.155340 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.155560 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.155647 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.155872 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.155966 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.156213 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.156315 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.156503 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.156596 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.156809 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.156941 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.157117 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.157209 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.157422 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.157508 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.157727 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.157822 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.158033 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.158118 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.158357 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.158455 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.158661 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.158757 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.158984 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.159071 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.159294 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.159382 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.159599 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.159693 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.159916 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.160007 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.160260 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.160351 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.160592 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.160686 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.160905 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.160998 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.161222 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.161307 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.161544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.161630 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.161856 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.161940 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.162175 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.162261 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.162565 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.162672 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.162850 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.162948 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.163117 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.163326 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.163432 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.163658 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.163754 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.163977 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.164070 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.164318 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.164416 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.164637 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.164732 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.164955 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.165086 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.165267 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.165361 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.165581 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.165681 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.165894 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.165987 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.166208 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.166312 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.166523 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.166731 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.166867 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.167064 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.167192 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.167384 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.167513 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.167703 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.167831 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.168021 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.168186 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.168362 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.168519 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.168682 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.168787 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.168996 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.169111 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.169309 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.169472 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.169623 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.169793 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.169937 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.170105 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.170265 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.170425 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.170591 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.170747 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.170917 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.171067 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.171254 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.171385 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.171572 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.171705 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.171890 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.172022 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.172230 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.172370 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.172554 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.172666 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.172911 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.173008 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.173230 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.173324 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.173538 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.173640 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.173852 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.173946 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.174171 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.174274 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.174487 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.174588 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.174800 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.174894 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.175110 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.175213 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.175425 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.175519 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.175764 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.175979 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.176074 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.176324 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.176419 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.176663 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.176757 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.176992 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.177096 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.177320 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.177458 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.177637 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.177765 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.177959 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.178105 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.178274 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.178405 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.178585 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.178714 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.178896 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.179037 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.179210 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.179419 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.179546 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.179738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.179867 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.180083 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.180264 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.180399 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.180531 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.180733 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.180869 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.181052 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.181182 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.181364 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.181493 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.181690 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.181909 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.182039 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.182263 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.182398 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.182585 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.182681 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.182895 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.183025 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.183201 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.183329 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.183524 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.183664 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.183837 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.183972 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.184159 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.184310 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.184485 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.184625 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.184797 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.184900 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.185117 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.185332 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.185420 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.185680 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.185767 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.185995 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.186080 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.186322 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.186409 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.186634 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.186720 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.186942 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.187030 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.187249 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.187343 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.187555 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.187640 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.187870 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.187955 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.188202 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.188396 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.188533 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.188621 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.188809 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.188946 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.189121 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.189261 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.189427 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.189553 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.189734 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.189866 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.190042 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.190221 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.190381 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.190522 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.190663 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.190802 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.190954 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.191095 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.191234 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.191901 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.192072 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.192266 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.192422 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.192564 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.192710 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.192882 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.193023 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.193161 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.193309 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.193457 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.193599 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.193738 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.193877 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.194015 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.194169 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.194311 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.194489 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.194639 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.194795 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.194944 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.195083 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.195230 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.195378 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.195519 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.195667 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.195815 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.195977 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.196125 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.196304 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.196454 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.196655 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.196951 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.197101 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.197272 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.197426 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.197566 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.197712 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.197861 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.198002 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.198177 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.198324 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.198500 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.198656 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.198808 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.198948 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.199110 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.199264 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.199438 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.199598 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.199741 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.199881 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.200054 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.200309 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.200461 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.200644 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.200793 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.200965 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.201121 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.201293 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.201446 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.201660 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.201803 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.201944 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.202082 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.202221 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.202369 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.202508 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.202654 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.202804 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.202942 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.203089 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.203241 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.203389 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.203530 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.203699 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.203846 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.204009 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.204193 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.204353 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.204503 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.204652 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.204803 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.204951 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.205099 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.205247 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.205393 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.205540 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.205679 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.205827 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.205968 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.206106 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.206246 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.206417 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.206575 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.206724 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.206864 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.207599 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.207742 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.207888 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.208037 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.208214 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.208369 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.208535 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.208688 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.208855 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.209011 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.209169 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.209312 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.209476 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.209629 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.209770 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.209942 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.210090 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.210259 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.210407 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.210585 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.210738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.210913 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.211070 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.211231 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.211379 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.211556 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.211711 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.211852 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.211992 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.212218 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.212369 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.212560 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.212718 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.212892 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.213052 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.213222 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.213367 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.213527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.213676 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.213816 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.213957 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.214105 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.214246 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.214425 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.214582 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.214733 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.214872 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.215047 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.215193 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.215346 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.215486 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.215626 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.215766 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.215943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.216098 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.216280 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.216424 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.216571 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.216720 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.216869 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.217018 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.217158 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.217297 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.217436 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.217576 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.217745 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.217902 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.218042 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.218190 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.218330 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.218469 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.218637 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.218803 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.218945 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.219085 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.219321 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.219467 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.219606 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.219756 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.219903 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.220050 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.220243 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.220388 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.220539 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.220687 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.220845 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.220985 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.221124 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.221263 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.221416 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.221557 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.221696 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.221835 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.221974 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.222115 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.222262 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.222403 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.222567 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.222722 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.222869 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.223011 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.223158 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.223299 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.223439 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.223589 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.223743 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.223892 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.224033 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.224203 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.224350 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.224501 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.224649 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.224797 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.224945 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.225110 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.225277 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.225419 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.225559 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.225708 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.225873 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.226021 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.226186 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.226333 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.226492 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.226640 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.226820 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.226968 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.227137 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.227297 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.227452 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.227593 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.227769 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.227924 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.228065 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.228272 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.228436 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.228585 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.228726 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.228873 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.229020 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.229160 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.229327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.229575 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.229676 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.229772 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.229916 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.230097 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.230244 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.230345 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.230552 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.230645 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.230879 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.230984 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.231204 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.231295 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.231525 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.231615 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.231842 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.231939 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.232175 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.232271 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.232499 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.232587 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.232812 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.232900 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.233125 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.233220 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.233438 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.233532 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.233750 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.233839 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.234062 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.234149 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.234379 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.234467 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.234693 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.234782 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.235006 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.235093 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.235326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.235437 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.235641 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.235729 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.235969 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.236056 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.236300 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.236402 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.236548 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 21:31:08.236638 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.236937 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.237266 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.237611 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.237925 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.238295 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.238627 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.238941 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.239256 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.239561 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:31:08.239804 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 21:31:08.391095 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO dbcounter [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Registered counter for database nova_api Aug 02 21:31:08.394093 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO dbcounter [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Registered counter for database nova_api Aug 02 21:31:08.413665 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_db.sqlalchemy.engines [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:31:08.415341 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG oslo_db.sqlalchemy.engines [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:31:08.420295 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writer thread running {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:31:08.421775 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writer thread running {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:31:08.476585 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.context [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78522f80-8c08-462b-a516-27a7c611540e(cell1) {{(pid=105136) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 21:31:08.477390 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.context [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78522f80-8c08-462b-a516-27a7c611540e(cell1) {{(pid=105135) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 21:31:08.480578 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:31:08.481325 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG oslo_concurrency.lockutils [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:31:08.482180 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:31:08.482912 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG oslo_concurrency.lockutils [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:31:08.483003 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:31:08.483717 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG oslo_concurrency.lockutils [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:31:08.484960 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:31:08.485719 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG oslo_concurrency.lockutils [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:31:08.486931 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO dbcounter [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Registered counter for database nova_cell0 Aug 02 21:31:08.487679 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO dbcounter [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Registered counter for database nova_cell0 Aug 02 21:31:08.493024 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO dbcounter [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Registered counter for database nova_cell1 Aug 02 21:31:08.493516 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO dbcounter [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Registered counter for database nova_cell1 Aug 02 21:31:08.500390 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_db.sqlalchemy.engines [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:31:08.502548 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_db.sqlalchemy.engines [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:31:08.503454 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG oslo_db.sqlalchemy.engines [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:31:08.507384 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG oslo_db.sqlalchemy.engines [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:31:08.507812 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writer thread running {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:31:08.510443 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writer thread running {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:31:08.648075 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writer thread running {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:31:08.649067 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writer thread running {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:31:08.656722 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO dbcounter [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Registered counter for database nova_cell0 Aug 02 21:31:08.657909 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO dbcounter [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Registered counter for database nova_cell0 Aug 02 21:31:08.665707 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_db.sqlalchemy.engines [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:31:08.669318 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG oslo_db.sqlalchemy.engines [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:31:08.670356 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writer thread running {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:31:08.673699 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writer thread running {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:31:09.005997 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: WARNING keystonemiddleware.auth_token [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 21:31:09.006610 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: WARNING keystonemiddleware.auth_token [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 21:31:09.013217 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: WARNING keystonemiddleware.auth_token [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 21:31:09.013675 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: WARNING keystonemiddleware.auth_token [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 21:31:09.354457 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: WARNING keystonemiddleware.auth_token [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 21:31:09.354813 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: WARNING keystonemiddleware.auth_token [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 21:31:09.360445 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: WARNING keystonemiddleware.auth_token [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 21:31:09.360775 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: WARNING keystonemiddleware.auth_token [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 21:31:09.365701 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e14fad99c0 pid: 105135 (default app) Aug 02 21:31:09.366018 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e14fad99c0 pid: 105136 (default app) Aug 02 21:31:09.367774 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:31:09.368977 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-a900b450-7150-4d63-8f14-a19de1433ade None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Aug 02 21:31:09.369388 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Tue Aug 2 21:31:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:24.633000 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:24.634211 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Aug 02 21:32:24.634600 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:24.646224 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writing DB stats nova_api:SELECT=3 {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:24.647053 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writing DB stats nova_cell0:SELECT=3 {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:24.648300 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writing DB stats nova_cell1:SELECT=3 {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:24.649032 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:25.521669 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-fc4521ca-418f-4706-9d16-dc1144a6d208 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:25.554153 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-fc4521ca-418f-4706-9d16-dc1144a6d208 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913719 Aug 02 21:32:25.554881 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1291 bytes} [Tue Aug 2 21:32:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:32:27.771647 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:27.772641 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-e300ec47-2c23-4f43-bf74-3ea8857795ed None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 02 21:32:27.778288 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 2/4] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:27 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:28.229977 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-718be130-51b7-4c28-8b34-fe720902f791 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:28.250728 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:32:28.250728 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: warnings.warn(msg) Aug 02 21:32:28.281667 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-718be130-51b7-4c28-8b34-fe720902f791 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502059 Aug 02 21:32:28.282483 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 3/5] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 21:32:28.296290 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_api:SELECT=3 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:28.297485 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_cell0:SELECT=3 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:28.298951 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_cell1:SELECT=3 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:28.300514 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:28.508994 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-96f83db4-56ee-4d1b-b328-20dbb409835b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:28.513370 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:32:28.513370 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: warnings.warn(msg) Aug 02 21:32:28.578081 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-96f83db4-56ee-4d1b-b328-20dbb409835b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286971 Aug 02 21:32:28.578880 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 3/6] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Aug 2 21:32:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:32:30.816939 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-718be130-51b7-4c28-8b34-fe720902f791 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:30.818759 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-718be130-51b7-4c28-8b34-fe720902f791 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Aug 02 21:32:30.819742 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 4/7] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:31.469862 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-cfcd5083-6847-41e8-8726-0d915fdeda4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "disk": 5}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:31.490050 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:32:31.490050 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: warnings.warn(msg) Aug 02 21:32:31.510939 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-cfcd5083-6847-41e8-8726-0d915fdeda4d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.684970 Aug 02 21:32:31.511741 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 4/8] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 21:32:31.523169 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-d451a6dd-84cf-45d7-943e-500342294e0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:31.526441 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:32:31.526441 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: warnings.warn(msg) Aug 02 21:32:31.562389 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-d451a6dd-84cf-45d7-943e-500342294e0b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042744 Aug 02 21:32:31.562982 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 5/9] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Aug 2 21:32:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:32:33.789871 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-cfcd5083-6847-41e8-8726-0d915fdeda4d admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:33.791172 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-cfcd5083-6847-41e8-8726-0d915fdeda4d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001779 Aug 02 21:32:33.801949 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:33 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:34.163765 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-d5c7ffed-a2e0-492d-9081-7bd4e4911f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G"}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:34.184988 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-d5c7ffed-a2e0-492d-9081-7bd4e4911f2c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.387396 Aug 02 21:32:34.185667 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 6/11] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 21:32:34.198280 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-d0b6d4f6-d0c4-402d-8396-abc75b728859 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:34.221368 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-d0b6d4f6-d0c4-402d-8396-abc75b728859 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027041 Aug 02 21:32:34.222529 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 6/12] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Aug 2 21:32:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:32:36.451162 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-d5c7ffed-a2e0-492d-9081-7bd4e4911f2c admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:36.452202 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-d5c7ffed-a2e0-492d-9081-7bd4e4911f2c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 02 21:32:36.452603 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 7/13] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:36.891613 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-f51d3f5c-7ad2-49d1-b7ba-77dcc6d224d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:36.911487 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-f51d3f5c-7ad2-49d1-b7ba-77dcc6d224d9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453225 Aug 02 21:32:36.912038 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 7/14] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:32:36.923783 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-a8c2c24c-9c00-4d8c-b690-64d0780751a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:36.947816 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-a8c2c24c-9c00-4d8c-b690-64d0780751a9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027671 Aug 02 21:32:36.948618 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 8/15] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Aug 2 21:32:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:32:39.203837 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-f51d3f5c-7ad2-49d1-b7ba-77dcc6d224d9 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:39.204898 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-f51d3f5c-7ad2-49d1-b7ba-77dcc6d224d9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Aug 02 21:32:39.205300 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 8/16] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:39.631737 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-dba358b3-bc33-42be-9561-98c0b75ed5a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:39.650988 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-dba358b3-bc33-42be-9561-98c0b75ed5a7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439065 Aug 02 21:32:39.658632 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 9/17] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:32:39.663879 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-6843ebae-6b46-47e7-baac-a17db7a4acc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:39.689062 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-6843ebae-6b46-47e7-baac-a17db7a4acc6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029075 Aug 02 21:32:39.690197 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 9/18] 10.222.0.57 () {64 vars in 1335 bytes} [Tue Aug 2 21:32:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:32:41.901334 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-dba358b3-bc33-42be-9561-98c0b75ed5a7 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:41.902669 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-dba358b3-bc33-42be-9561-98c0b75ed5a7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002263 Aug 02 21:32:41.903248 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 10/19] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:42.307894 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-fd0d05a9-659c-45dc-b8ae-1dfaa3583e00 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:42.332549 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-fd0d05a9-659c-45dc-b8ae-1dfaa3583e00 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.423363 Aug 02 21:32:42.333012 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 10/20] 10.222.0.57 () {60 vars in 1291 bytes} [Tue Aug 2 21:32:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:32:44.612168 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-dba358b3-bc33-42be-9561-98c0b75ed5a7 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:44.613308 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-dba358b3-bc33-42be-9561-98c0b75ed5a7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Aug 02 21:32:44.613852 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 11/21] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:32:45.115190 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-91569a0c-777d-4fe3-8d17-f9e726cc450a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1"}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:45.138553 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-91569a0c-777d-4fe3-8d17-f9e726cc450a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518514 Aug 02 21:32:45.139298 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 11/22] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:32:45.155652 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-061dc034-12ee-49c5-a075-46872cd54811 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:45.185691 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-061dc034-12ee-49c5-a075-46872cd54811 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035007 Aug 02 21:32:45.186620 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 12/23] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Aug 2 21:32:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:32:47.524560 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-91569a0c-777d-4fe3-8d17-f9e726cc450a admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:47.525834 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-91569a0c-777d-4fe3-8d17-f9e726cc450a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 02 21:32:47.526241 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:47.966538 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-f13251f0-b1c8-4d6b-bf50-1235bce4f448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:47.987911 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-f13251f0-b1c8-4d6b-bf50-1235bce4f448 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455118 Aug 02 21:32:47.991038 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 13/25] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:32:48.001102 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-569780a3-c5a5-40c0-a6d9-77b180bcf8eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:48.027106 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-569780a3-c5a5-40c0-a6d9-77b180bcf8eb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029725 Aug 02 21:32:48.036252 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 13/26] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Aug 2 21:32:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:32:50.260512 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-f13251f0-b1c8-4d6b-bf50-1235bce4f448 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:50.262169 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-f13251f0-b1c8-4d6b-bf50-1235bce4f448 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 Aug 02 21:32:50.266645 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:50.681437 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-6cc06bdb-f2f3-4303-8d32-f19acc4c37f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "swap": 0, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:50.701168 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-6cc06bdb-f2f3-4303-8d32-f19acc4c37f9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.431502 Aug 02 21:32:50.701718 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 14/28] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 21:32:50.713978 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-19d602ce-2c90-442c-bcf5-b46ddc40bc3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:50.739301 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-19d602ce-2c90-442c-bcf5-b46ddc40bc3a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028989 Aug 02 21:32:50.740321 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 15/29] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Aug 2 21:32:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:32:53.014758 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-6cc06bdb-f2f3-4303-8d32-f19acc4c37f9 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:53.016515 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-6cc06bdb-f2f3-4303-8d32-f19acc4c37f9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 Aug 02 21:32:53.016929 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 15/30] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:53.464431 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-9a129543-6970-4357-b707-dd2334fce7f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4"}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:53.483905 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-9a129543-6970-4357-b707-dd2334fce7f8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459744 Aug 02 21:32:53.484581 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 16/31] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:32:53.496903 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-901bd26e-83e7-463c-a35a-7986d2ec940a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:53.522927 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-901bd26e-83e7-463c-a35a-7986d2ec940a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029557 Aug 02 21:32:53.523856 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 16/32] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Aug 2 21:32:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:32:55.832327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-9a129543-6970-4357-b707-dd2334fce7f8 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:32:55.834203 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-9a129543-6970-4357-b707-dd2334fce7f8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002876 Aug 02 21:32:55.840260 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 17/33] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:32:55 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:32:56.285487 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-0f43c297-7b42-4c0a-a667-660516a607a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "id": "5"}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:56.307085 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-0f43c297-7b42-4c0a-a667-660516a607a8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465590 Aug 02 21:32:56.307645 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 17/34] 10.222.0.57 () {64 vars in 1282 bytes} [Tue Aug 2 21:32:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:32:56.320049 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-a9f8b3c1-d6fc-4d68-80dd-58159943daf7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:32:56.325012 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:56.355722 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-a9f8b3c1-d6fc-4d68-80dd-58159943daf7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039246 Aug 02 21:32:56.356443 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 18/35] 10.222.0.57 () {64 vars in 1332 bytes} [Tue Aug 2 21:32:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:33:16.316830 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-0f43c297-7b42-4c0a-a667-660516a607a8 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:16.317840 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-0f43c297-7b42-4c0a-a667-660516a607a8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 02 21:33:16.318237 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 18/36] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:16.328450 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:16.717292 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-f5c44e85-5a8f-44fd-973a-a8a7232b0624 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:16.735748 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-f5c44e85-5a8f-44fd-973a-a8a7232b0624 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.411756 Aug 02 21:33:16.736227 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1291 bytes} [Tue Aug 2 21:33:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:33:17.788522 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-0f43c297-7b42-4c0a-a667-660516a607a8 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:17.789579 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-0f43c297-7b42-4c0a-a667-660516a607a8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 02 21:33:17.789978 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 19/38] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:33:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:18.313378 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-7b2c7e79-2f31-4a1e-9406-c60b2f23ad9e admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:18.318950 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.wsgi [None req-7b2c7e79-2f31-4a1e-9406-c60b2f23ad9e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-7b2c7e79-2f31-4a1e-9406-c60b2f23ad9e admin admin] Request method failure captured: Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Accept: application/json Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Accept-Encoding: gzip, deflate Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Connection: keep-alive Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Content-Length: 0 Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Host: 10.222.0.57 Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Openstack-Api-Version: compute 2.90 Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Openstack-System-Scope: None Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: User-Agent: python-novaclient Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Auth-Token: gAAAAABi6Zgd2dqzokkVQNsJWo0amIm0iox8tNXeN_px_Vt8815rsE44SpR79sv1BVo2YFFdt_H2LkcA-QhHkcLTjwEJWFTCpoz5Vuyk8fnTuWY0debOIjHYcvD706UroURYL1obGogG8ENKKTQezccw2wmtCZqiCqKPJ7QBwGVZ6urTB4Kqx2A Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Domain-Id: None Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Domain-Name: None Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Identity-Status: Confirmed Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Is-Admin-Project: True Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Domain-Id: default Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Domain-Name: Default Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Name: admin Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Role: admin,member,reader Aug 02 21:33:18.322327 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Roles: admin,member,reader Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant: admin Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant-Name: admin Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User: admin Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Domain-Id: default Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Domain-Name: Default Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Id: 26d170ed749e495e8c4adc26cb1aaae7 Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Name: admin Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: method: > Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: exception: Flavor 42 could not be found. Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: action_args: {'id': '42'} Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:33:18.323933 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:18.324860 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.326326 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-7b2c7e79-2f31-4a1e-9406-c60b2f23ad9e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:33:18.327653 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-7b2c7e79-2f31-4a1e-9406-c60b2f23ad9e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396146 Aug 02 21:33:18.327653 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 20/39] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 2 21:33:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:18.333831 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-c83efeee-3338-49f5-8e8a-1ff76d5fede3 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:18.338090 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:18.357879 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-c83efeee-3338-49f5-8e8a-1ff76d5fede3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028037 Aug 02 21:33:18.358405 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 20/40] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 2 21:33:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:33:18.367994 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-7476ed5f-df79-4145-8a52-b4f3181fb143 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:18.391107 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-7476ed5f-df79-4145-8a52-b4f3181fb143 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026685 Aug 02 21:33:18.391633 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 21/41] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 2 21:33:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:33:18.402638 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-457d232d-e458-41fc-b0fe-3e65093f201b admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:18.409720 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.wsgi [None req-457d232d-e458-41fc-b0fe-3e65093f201b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-457d232d-e458-41fc-b0fe-3e65093f201b admin admin] Request method failure captured: Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Accept: application/json Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Accept-Encoding: gzip, deflate Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Connection: keep-alive Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Content-Length: 0 Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Host: 10.222.0.57 Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Openstack-Api-Version: compute 2.90 Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Openstack-System-Scope: None Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: User-Agent: python-novaclient Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Auth-Token: gAAAAABi6Zgd2dqzokkVQNsJWo0amIm0iox8tNXeN_px_Vt8815rsE44SpR79sv1BVo2YFFdt_H2LkcA-QhHkcLTjwEJWFTCpoz5Vuyk8fnTuWY0debOIjHYcvD706UroURYL1obGogG8ENKKTQezccw2wmtCZqiCqKPJ7QBwGVZ6urTB4Kqx2A Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Domain-Id: None Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Domain-Name: None Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Identity-Status: Confirmed Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Is-Admin-Project: True Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Domain-Id: default Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Domain-Name: Default Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Name: admin Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Role: admin,member,reader Aug 02 21:33:18.412947 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Roles: admin,member,reader Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant: admin Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant-Name: admin Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User: admin Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Domain-Id: default Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Domain-Name: Default Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Id: 26d170ed749e495e8c4adc26cb1aaae7 Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Name: admin Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: method: > Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: exception: Flavor 42 could not be found. Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: action_args: {'id': '42'} Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:33:18.414474 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:18.415445 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:18.416574 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-457d232d-e458-41fc-b0fe-3e65093f201b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:33:18.417547 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-457d232d-e458-41fc-b0fe-3e65093f201b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016388 Aug 02 21:33:18.417547 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 21/42] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 2 21:33:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:19.373240 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-7476ed5f-df79-4145-8a52-b4f3181fb143 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:19.374249 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-7476ed5f-df79-4145-8a52-b4f3181fb143 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 02 21:33:19.374646 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 22/43] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:19.889526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-db43434e-521a-4249-b28e-3438125550bb admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:19.895327 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.wsgi [None req-db43434e-521a-4249-b28e-3438125550bb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-db43434e-521a-4249-b28e-3438125550bb admin admin] Request method failure captured: Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Accept: application/json Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Accept-Encoding: gzip, deflate Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Connection: keep-alive Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Content-Length: 0 Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Host: 10.222.0.57 Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Openstack-Api-Version: compute 2.90 Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Openstack-System-Scope: None Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: User-Agent: python-novaclient Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Auth-Token: gAAAAABi6ZgfAmcnF45gNnbJEKDO-Ctm3HmM3q22tIFf5vzGUPJ1EcIZlfnrO39eWZPg2uPEVbbuEHeeY1xCwV3h8GGKWM1x0IJMtQRCjTkiTPa1Wv4ctb97Mqmi3TiVHdVBdpVPnH8PBA4YunZEWWI_Mq4XPtgbzvRMUIWv2ryD61NY0brjDB0 Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Domain-Id: None Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Domain-Name: None Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Identity-Status: Confirmed Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Is-Admin-Project: True Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Domain-Id: default Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Domain-Name: Default Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Name: admin Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Role: admin,member,reader Aug 02 21:33:19.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Roles: admin,member,reader Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant: admin Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant-Name: admin Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User: admin Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Domain-Id: default Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Domain-Name: Default Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Id: 26d170ed749e495e8c4adc26cb1aaae7 Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Name: admin Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: method: > Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: exception: Flavor 84 could not be found. Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: action_args: {'id': '84'} Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:33:19.898440 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:19.899373 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.900526 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-db43434e-521a-4249-b28e-3438125550bb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:33:19.902400 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-db43434e-521a-4249-b28e-3438125550bb admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387844 Aug 02 21:33:19.902400 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 22/44] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 2 21:33:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:19.908245 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-65fcac06-0fc1-4b49-8c9f-8a6fd4627906 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:19.923627 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-65fcac06-0fc1-4b49-8c9f-8a6fd4627906 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018983 Aug 02 21:33:19.924160 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 23/45] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 2 21:33:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:33:19.933386 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-16c07334-96af-402c-b1bd-1cd6420d2679 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:19.948418 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-16c07334-96af-402c-b1bd-1cd6420d2679 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018527 Aug 02 21:33:19.948957 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 2 21:33:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:33:19.958722 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-16a79e02-9cbe-40e4-a2a9-e0bc5b958b96 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:19.963937 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.wsgi [None req-16a79e02-9cbe-40e4-a2a9-e0bc5b958b96 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-16a79e02-9cbe-40e4-a2a9-e0bc5b958b96 admin admin] Request method failure captured: Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Accept: application/json Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Accept-Encoding: gzip, deflate Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Connection: keep-alive Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Content-Length: 0 Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Host: 10.222.0.57 Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Openstack-Api-Version: compute 2.90 Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Openstack-System-Scope: None Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: User-Agent: python-novaclient Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Auth-Token: gAAAAABi6ZgfAmcnF45gNnbJEKDO-Ctm3HmM3q22tIFf5vzGUPJ1EcIZlfnrO39eWZPg2uPEVbbuEHeeY1xCwV3h8GGKWM1x0IJMtQRCjTkiTPa1Wv4ctb97Mqmi3TiVHdVBdpVPnH8PBA4YunZEWWI_Mq4XPtgbzvRMUIWv2ryD61NY0brjDB0 Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Domain-Id: None Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Domain-Name: None Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Identity-Status: Confirmed Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Is-Admin-Project: True Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Domain-Id: default Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Domain-Name: Default Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Name: admin Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Role: admin,member,reader Aug 02 21:33:19.965462 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Roles: admin,member,reader Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant: admin Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant-Name: admin Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User: admin Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Domain-Id: default Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Domain-Name: Default Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Id: 26d170ed749e495e8c4adc26cb1aaae7 Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Name: admin Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: method: > Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: exception: Flavor 84 could not be found. Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: action_args: {'id': '84'} Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:33:19.966883 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:19.967634 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:19.968738 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-16a79e02-9cbe-40e4-a2a9-e0bc5b958b96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:33:19.969729 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-16a79e02-9cbe-40e4-a2a9-e0bc5b958b96 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012193 Aug 02 21:33:19.969729 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 24/47] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 2 21:33:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:20.939349 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-16c07334-96af-402c-b1bd-1cd6420d2679 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:20.940423 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-16c07334-96af-402c-b1bd-1cd6420d2679 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 02 21:33:20.940825 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 24/48] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:33:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:21.454245 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-8a454e6e-f31b-45f2-8cc0-c41de6927b95 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:21.460527 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.wsgi [None req-8a454e6e-f31b-45f2-8cc0-c41de6927b95 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-8a454e6e-f31b-45f2-8cc0-c41de6927b95 admin admin] Request method failure captured: Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Accept: application/json Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Accept-Encoding: gzip, deflate Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Connection: keep-alive Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Content-Length: 0 Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Host: 10.222.0.57 Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Openstack-Api-Version: compute 2.90 Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Openstack-System-Scope: None Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: User-Agent: python-novaclient Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Auth-Token: gAAAAABi6ZggkmtaOgx9E9qYMI7QzqQC8lVwiJhiRNu1xbVFSrk5NAbkqgvGRbpUfhgtc3-Wj4AohgdAFE0ZiGPOnedXVoU-88QVOV_dNeb0yMDMb7cYv9MacvzNS3rPl9Ymafy3eyZ3V4uToJupUnS7N3rp1rxQEZl98BuN9hzucDRyqgH3-p4 Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Domain-Id: None Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Domain-Name: None Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Identity-Status: Confirmed Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Is-Admin-Project: True Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Domain-Id: default Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Domain-Name: Default Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Project-Name: admin Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Role: admin,member,reader Aug 02 21:33:21.462040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Roles: admin,member,reader Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant: admin Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-Tenant-Name: admin Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User: admin Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Domain-Id: default Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Domain-Name: Default Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Id: 26d170ed749e495e8c4adc26cb1aaae7 Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: X-User-Name: admin Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: method: > Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: exception: Flavor 451 could not be found. Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: action_args: {'id': '451'} Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:33:21.463555 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:21.464544 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.466089 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-8a454e6e-f31b-45f2-8cc0-c41de6927b95 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:33:21.467313 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-8a454e6e-f31b-45f2-8cc0-c41de6927b95 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386119 Aug 02 21:33:21.467313 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 25/49] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 2 21:33:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:21.473887 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-a33b476f-1ca5-4a41-a4a7-eaa4dfaaf5df admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:21.488679 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-a33b476f-1ca5-4a41-a4a7-eaa4dfaaf5df admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019257 Aug 02 21:33:21.489201 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 25/50] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 2 21:33:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:33:21.498362 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:21.513504 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018687 Aug 02 21:33:21.514020 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 26/51] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 2 21:33:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:33:21.523852 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-de711829-b0c0-4fe3-a6a4-23c56a50f0d5 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:21.529389 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.wsgi [None req-de711829-b0c0-4fe3-a6a4-23c56a50f0d5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-de711829-b0c0-4fe3-a6a4-23c56a50f0d5 admin admin] Request method failure captured: Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Accept: application/json Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Accept-Encoding: gzip, deflate Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Connection: keep-alive Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Content-Length: 0 Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Host: 10.222.0.57 Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Openstack-Api-Version: compute 2.90 Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Openstack-System-Scope: None Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: User-Agent: python-novaclient Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Auth-Token: gAAAAABi6ZggkmtaOgx9E9qYMI7QzqQC8lVwiJhiRNu1xbVFSrk5NAbkqgvGRbpUfhgtc3-Wj4AohgdAFE0ZiGPOnedXVoU-88QVOV_dNeb0yMDMb7cYv9MacvzNS3rPl9Ymafy3eyZ3V4uToJupUnS7N3rp1rxQEZl98BuN9hzucDRyqgH3-p4 Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Domain-Id: None Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Domain-Name: None Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Identity-Status: Confirmed Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Is-Admin-Project: True Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Domain-Id: default Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Domain-Name: Default Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Project-Name: admin Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Role: admin,member,reader Aug 02 21:33:21.530875 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Roles: admin,member,reader Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a739ee2f7d746e0a37b1f7b651a505d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant: admin Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant-Id: 4a739ee2f7d746e0a37b1f7b651a505d Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-Tenant-Name: admin Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User: admin Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Domain-Id: default Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Domain-Name: Default Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Id: 26d170ed749e495e8c4adc26cb1aaae7 Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: X-User-Name: admin Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: method: > Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: exception: Flavor 451 could not be found. Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: action_args: {'id': '451'} Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:33:21.532483 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:21.533527 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: ERROR nova.api.openstack.wsgi Aug 02 21:33:21.534776 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-de711829-b0c0-4fe3-a6a4-23c56a50f0d5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:33:21.536041 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-de711829-b0c0-4fe3-a6a4-23c56a50f0d5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011866 Aug 02 21:33:21.536041 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 26/52] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 2 21:33:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:22.493996 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:22.495029 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 02 21:33:22.495420 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 27/53] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:23.024084 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-140e00a2-b7de-44ae-8094-a076664ad12d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:33:23.042955 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-140e00a2-b7de-44ae-8094-a076664ad12d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403205 Aug 02 21:33:23.043494 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 27/54] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 2 21:33:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:33:24.015961 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:24.017002 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 02 21:33:24.017438 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 28/55] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:24.544437 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-9f80471a-997f-418a-af3d-d3326fe14a65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:33:24.563266 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-9f80471a-997f-418a-af3d-d3326fe14a65 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.409250 Aug 02 21:33:24.563811 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 28/56] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 2 21:33:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:33:25.527945 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:25.529029 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 02 21:33:25.529428 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 29/57] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:33:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:26.054352 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-98b84bf1-7108-4559-9ac5-bf40821a7501 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:33:26.073218 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-98b84bf1-7108-4559-9ac5-bf40821a7501 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400312 Aug 02 21:33:26.073756 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 29/58] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 2 21:33:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 21:33:27.156791 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:27.157803 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 02 21:33:27.158187 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 30/59] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:27.677181 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-6c3a50bf-c42a-4896-b939-363c149e9ef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:33:27.695602 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-6c3a50bf-c42a-4896-b939-363c149e9ef1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400854 Aug 02 21:33:27.696162 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 30/60] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 2 21:33:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 21:33:28.650386 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:28.651392 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 02 21:33:28.652040 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 31/61] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:33:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:33:29.161948 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-9ef47969-586b-4356-8557-fb338a2dacea admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:33:29.181838 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-9ef47969-586b-4356-8557-fb338a2dacea admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.395557 Aug 02 21:33:29.182370 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 31/62] 10.222.0.57 () {60 vars in 1202 bytes} [Tue Aug 2 21:33:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:34:20.399256 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:34:20.400396 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-0be7cc5d-4686-4b28-b391-8383d37123fe admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 02 21:34:20.400801 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 32/63] 10.222.0.57 () {54 vars in 930 bytes} [Tue Aug 2 21:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:34:20.411510 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:20.788971 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-80e01476-a221-4895-9482-caf69de4c733 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:34:20.810162 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-80e01476-a221-4895-9482-caf69de4c733 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403026 Aug 02 21:34:20.810656 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 32/64] 10.222.0.57 () {60 vars in 1291 bytes} [Tue Aug 2 21:34:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:34:20.833477 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-d43e0ca9-f70f-4897-b9b5-2338af2b751b admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:34:20.836928 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG dbcounter [-] [105135] Writing DB stats nova_api:SELECT=14 {{(pid=105135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:20.842678 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-d43e0ca9-f70f-4897-b9b5-2338af2b751b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013049 Aug 02 21:34:20.843190 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 33/65] 10.222.0.57 () {60 vars in 1282 bytes} [Tue Aug 2 21:34:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:34:20.854984 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-d590bf65-d87e-4727-b27d-d5eb005b962b admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:34:20.863199 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-d590bf65-d87e-4727-b27d-d5eb005b962b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011829 Aug 02 21:34:20.863717 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 33/66] 10.222.0.57 () {60 vars in 1285 bytes} [Tue Aug 2 21:34:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:34:20.874635 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:34:20.881991 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010828 Aug 02 21:34:20.882501 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 34/67] 10.222.0.57 () {60 vars in 1285 bytes} [Tue Aug 2 21:34:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:34:20.893266 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-12ef12fe-dfce-4e6b-8be0-1bc368c61de0 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:34:20.900667 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-12ef12fe-dfce-4e6b-8be0-1bc368c61de0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010854 Aug 02 21:34:20.901179 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 34/68] 10.222.0.57 () {60 vars in 1282 bytes} [Tue Aug 2 21:34:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:37:58.293980 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:37:58.295003 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 02 21:37:58.295412 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 35/69] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:37:58.438412 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_api:SELECT=6 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:58.594123 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-2a5c7b1e-2e0f-4dbe-ba41-a2d4c1e38552 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:37:58.596498 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:58.596498 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: warnings.warn(msg) Aug 02 21:37:58.597712 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-2a5c7b1e-2e0f-4dbe-ba41-a2d4c1e38552 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:37:58.598152 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-2a5c7b1e-2e0f-4dbe-ba41-a2d4c1e38552 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:37:58.598970 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-2a5c7b1e-2e0f-4dbe-ba41-a2d4c1e38552 admin admin] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:37:58.599402 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-2a5c7b1e-2e0f-4dbe-ba41-a2d4c1e38552 admin admin] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:37:58.633209 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-2a5c7b1e-2e0f-4dbe-ba41-a2d4c1e38552 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196318 Aug 02 21:37:58.633757 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 35/70] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 2 21:37:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:37:59.451512 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:37:59.452557 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 02 21:37:59.452960 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 36/71] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:37:59.639692 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-e74d91d2-28e1-41e1-a0b5-ece9bbc1719d admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:37:59.642083 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:59.642083 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: warnings.warn(msg) Aug 02 21:37:59.643270 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-e74d91d2-28e1-41e1-a0b5-ece9bbc1719d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:37:59.643743 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-e74d91d2-28e1-41e1-a0b5-ece9bbc1719d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:37:59.644569 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-e74d91d2-28e1-41e1-a0b5-ece9bbc1719d admin admin] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:37:59.645033 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-e74d91d2-28e1-41e1-a0b5-ece9bbc1719d admin admin] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:37:59.664242 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-e74d91d2-28e1-41e1-a0b5-ece9bbc1719d admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075326 Aug 02 21:37:59.664732 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 36/72] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 2 21:37:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:38:10.873065 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:38:10.874097 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 02 21:38:10.874493 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 37/73] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:38:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:38:11.018390 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_cell0:SELECT=4 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:11.019228 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_cell1:SELECT=4 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:11.019873 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG dbcounter [-] [105136] Writing DB stats nova_api:SELECT=8 {{(pid=105136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:11.082816 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-946709d1-8ab1-4651-a627-f628cbdd1136 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:38:11.085316 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:38:11.085316 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: warnings.warn(msg) Aug 02 21:38:11.086614 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-946709d1-8ab1-4651-a627-f628cbdd1136 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:38:11.087137 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-946709d1-8ab1-4651-a627-f628cbdd1136 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:38:11.088111 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-946709d1-8ab1-4651-a627-f628cbdd1136 admin admin] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:38:11.088599 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-946709d1-8ab1-4651-a627-f628cbdd1136 admin admin] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:38:11.114354 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-946709d1-8ab1-4651-a627-f628cbdd1136 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.100507 Aug 02 21:38:11.114941 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 37/74] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 2 21:38:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:38:11.933140 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: DEBUG nova.api.openstack.wsgi [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] Calling method '>' {{(pid=105135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:38:11.934230 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: INFO nova.api.openstack.requestlog [None req-00d23c30-f538-41d5-a9f1-d4539f8a0e20 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 02 21:38:11.934676 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: [pid: 105135|app: 0|req: 38/75] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 2 21:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:38:12.132465 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG nova.api.openstack.wsgi [None req-51f756a1-f976-42a1-b491-4ba0971ca682 admin admin] Calling method '>' {{(pid=105136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:38:12.135394 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:38:12.135394 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: warnings.warn(msg) Aug 02 21:38:12.136642 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-51f756a1-f976-42a1-b491-4ba0971ca682 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:38:12.137112 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-51f756a1-f976-42a1-b491-4ba0971ca682 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:38:12.137904 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-51f756a1-f976-42a1-b491-4ba0971ca682 admin admin] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:38:12.138337 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: DEBUG oslo_concurrency.lockutils [None req-51f756a1-f976-42a1-b491-4ba0971ca682 admin admin] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:38:12.160980 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: INFO nova.api.openstack.requestlog [None req-51f756a1-f976-42a1-b491-4ba0971ca682 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081092 Aug 02 21:38:12.161532 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: [pid: 105136|app: 0|req: 38/76] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 2 21:38:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:39:09.489221 dv-cinder-851449-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 21:39:09.489708 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: Tue Aug 2 21:39:09 2022 - graceful shutdown triggered... Aug 02 21:39:09.490148 dv-cinder-851449-4-iscsi devstack@n-api.service[105135]: Gracefully killing worker 1 (pid: 105135)... Aug 02 21:39:09.492223 dv-cinder-851449-4-iscsi devstack@n-api.service[105136]: Gracefully killing worker 2 (pid: 105136)... Aug 02 21:39:10.490543 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: worker 1 buried after 1 seconds Aug 02 21:39:10.491006 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: worker 2 buried after 1 seconds Aug 02 21:39:10.491006 dv-cinder-851449-4-iscsi devstack@n-api.service[105134]: goodbye to uWSGI. Aug 02 21:39:10.492221 dv-cinder-851449-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 02 21:39:10.492868 dv-cinder-851449-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 21:39:10.495800 dv-cinder-851449-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 21:39:10.506630 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 21:39:10 2022] *** Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: nodename: dv-cinder-851449-4-iscsi Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: machine: x86_64 Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: clock source: unix Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: pcre jit disabled Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: detected number of CPU cores: 4 Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: current working directory: / Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: detected binary path: /usr/bin/uwsgi-core Aug 02 21:39:10.509266 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: your processes number limit is 47680 Aug 02 21:39:10.510096 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: your memory page size is 4096 bytes Aug 02 21:39:10.510096 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: detected max file descriptor number: 2048 Aug 02 21:39:10.510096 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: lock engine: pthread robust mutexes Aug 02 21:39:10.510096 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: thunder lock: enabled Aug 02 21:39:10.510096 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 21:39:10.510096 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 21:39:10.558194 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: Python main interpreter initialized at 0x5584f0f299c0 Aug 02 21:39:10.558194 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: python threads support enabled Aug 02 21:39:10.558194 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: your server socket listen backlog is limited to 100 connections Aug 02 21:39:10.558194 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: your mercy for graceful operations on workers is 90 seconds Aug 02 21:39:10.558964 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 21:39:10.558964 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: *** Operational MODE: preforking *** Aug 02 21:39:10.559502 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: *** uWSGI is running in multiple interpreter mode *** Aug 02 21:39:10.559502 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: spawned uWSGI master process (pid: 124819) Aug 02 21:39:10.559844 dv-cinder-851449-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 21:39:10.560633 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: spawned uWSGI worker 1 (pid: 124839, cores: 1) Aug 02 21:39:10.564176 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: spawned uWSGI worker 2 (pid: 124840, cores: 1) Aug 02 21:39:10.564176 dv-cinder-851449-4-iscsi devstack@n-api.service[124819]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 21:39:11.224292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 21:39:11.241233 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 21:39:12.371146 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:39:12.371146 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: from cryptography.utils import int_from_bytes Aug 02 21:39:12.371788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:39:12.371788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: from cryptography.utils import int_from_bytes Aug 02 21:39:12.410634 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:39:12.410634 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: from cryptography.utils import int_from_bytes Aug 02 21:39:12.411177 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:39:12.411177 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: from cryptography.utils import int_from_bytes Aug 02 21:39:14.804231 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 21:39:14.804231 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 21:39:14.804831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 21:39:14.804831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 21:39:14.805003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 21:39:14.808345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808984 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808984 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.808984 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.809272 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-4-iscsi {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.809757 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.810395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.810874 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.811360 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.811850 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.812378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.812878 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.813676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.814187 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.814651 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.815116 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.815634 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.816127 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.816484 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.816819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.817144 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.817491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.817817 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.818242 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-4-iscsi {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.818577 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.818906 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.819233 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.819670 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.819993 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.820342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.820674 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.821006 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.821336 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.821663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.821998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.822327 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.822655 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.822961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.823845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.824198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.824531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.824846 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.825162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.825422 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.825742 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.826074 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.826407 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.826738 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.826997 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.827260 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.827587 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.827916 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.828269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.828585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.828901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.829219 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.829533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.829851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.830165 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.830482 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.830809 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.831132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.831466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.831781 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.832114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.832562 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.832815 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.833132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.833481 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.833806 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.834122 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.834449 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.834780 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.835094 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.835410 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.835726 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.836051 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.836424 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.836742 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.836999 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.837323 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.837621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.837943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.838256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.838576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.838924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.839291 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.839606 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.839918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.840255 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.840572 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.840886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.841198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.841525 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.841823 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.842140 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.842465 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.842791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.843105 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.843419 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.843732 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.844044 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.844395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.844708 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.845023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.845352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.845664 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.845974 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.846296 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.846607 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.846924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.847241 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.847546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.847859 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.848201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.848515 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.848828 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.849135 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.849447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.849756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.850063 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.850374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.850680 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.850982 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.851304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.851632 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.851949 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.852287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.852603 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.852926 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.853276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.853617 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.853969 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.854290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.854663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.855003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.855331 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.855649 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.855973 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.856331 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.856652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.856977 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.857292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.857616 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.857972 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.858280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.858601 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.858950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.859252 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.859412 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 21:39:14.859931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.860078 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 21:39:14.860281 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.860436 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 21:39:14.860590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.860734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 21:39:14.860893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.861042 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 21:39:14.861272 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.861423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.861572 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.861733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.863512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.864359 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.864515 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.864670 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.864816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.864967 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.865125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.865280 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.865424 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.865424 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.865701 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.865855 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.866016 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.866159 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.866301 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.866301 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.866578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.866719 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.866873 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.867015 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-4-iscsi {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.867158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.867326 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.867899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.867899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.868270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.868424 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.871661 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.872381 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.872539 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.872693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.872848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.872990 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.873143 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.873285 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.873427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.873574 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.873574 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.873849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.874016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.874165 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.874315 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.874458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.874616 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.874772 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.874921 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.875070 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.875211 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.875351 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.875500 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.875654 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.875796 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.875947 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.876096 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.876289 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.876459 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.876602 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.876753 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.876894 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.877042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.877193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-4-iscsi {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.877334 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.877474 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.877663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.877809 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.877959 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.878115 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.878263 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.878263 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.878549 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.878717 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.878859 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.879011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.879160 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.879301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.879449 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.880101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.880300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.880454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.880616 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.880768 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.880930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.881071 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.881221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.881363 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.881511 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.881659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.881802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.881950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.882100 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.882242 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.882383 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.882531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.882682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.882825 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.882979 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.883128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.883277 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.883426 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.883578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.883732 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.883881 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.884030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.884213 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.884371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.884514 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.884677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.884819 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.884962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.885110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.885110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.885390 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.885544 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.886927 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.887084 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.887238 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.887382 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.887551 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.887702 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.887844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.887992 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.888155 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.888305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.888465 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.888615 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.890820 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.891011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.891165 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.891312 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.891467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.891632 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.891776 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.891917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.892067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.892358 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.893137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.893293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.893438 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.893587 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.893736 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.893899 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.894055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.894212 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.894718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.894718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.895010 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.895163 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.895318 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.895462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.895603 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.895752 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.895904 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.896054 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.896237 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.896393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.896543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.896697 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.896845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.896993 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.897217 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.897373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.897518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.897659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.897807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.897956 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.898118 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.898272 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.898420 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.898574 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.898724 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.898724 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.899008 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.899148 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.899297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.899445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.899594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.899744 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.900358 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.900513 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.900690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.900932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.901098 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.901301 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.901499 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.901668 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.901821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.901963 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.902104 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.902259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.902401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.902543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.902693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.902843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.902994 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.903155 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.903558 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.903710 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.903861 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.904009 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.904209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.904367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.904625 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.904784 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.904928 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.905069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.905222 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.905364 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.905527 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.905669 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.905818 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.905969 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.906119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.906269 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.906417 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.906558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.906706 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.906862 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.907014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.907163 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.907304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.907469 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.907617 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.907766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.907907 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.908056 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.908771 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.908937 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.909092 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.909244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.909387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.909536 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.909694 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.909836 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.909836 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.910499 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.910665 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.910812 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.910981 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.911212 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.911367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.911510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.911653 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.911793 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.911944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.912096 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.912300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.912445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.912586 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.912726 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.912878 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.913019 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.913175 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.913317 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.913457 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.913606 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.913799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.913951 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.914123 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.914290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.914433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.914606 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.919663 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.919850 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.920006 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.920253 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.920487 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.920655 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.920811 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.920966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.921117 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.922997 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.923180 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:39:14.923342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.923491 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.923646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.923792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.923943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.924100 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.924274 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.924417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.924560 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.924560 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.924832 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.925024 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.925183 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.925326 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.925468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.925616 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.925760 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.928235 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.928414 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.928571 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.928730 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.928884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.929039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.929183 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.929366 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.929523 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.929668 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.929818 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.929971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.930122 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.930273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.930415 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.930556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.930699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.930866 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.931019 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.931170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.931343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.931535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.931697 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.931850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.931994 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.932184 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.932347 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.934208 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.934371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.934533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.934679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.934829 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.934972 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.935191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.935353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.935497 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.935640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.935782 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.935924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.936066 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.936301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.936475 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.936626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.936777 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.936920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.937359 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.937645 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.937798 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.939063 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.939220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.939439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.939678 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.939678 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.939955 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.940097 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.940286 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.940440 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.940616 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.940785 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.940947 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.941092 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.941264 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.941471 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.941632 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.941784 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.942596 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.942787 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.942953 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.943163 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.943561 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.943765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.943924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.944052 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.944410 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.945682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.945847 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.945995 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.946138 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.946292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.946488 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.946650 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.946802 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.946963 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.947114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.947280 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.947432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.947574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.947724 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.947874 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.948023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.949543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.949811 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.949973 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.950133 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.950285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.950858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.951087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.951211 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.952048 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.952257 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.952423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.952589 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.952740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.952935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.953105 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.953337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.953515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.955113 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.955297 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.955507 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.955663 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.955821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.955979 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.956242 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.956412 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.956573 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.956725 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.956881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.957039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.957254 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.957415 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.957571 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.957745 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.957903 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.958067 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.958224 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.958414 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.958563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.958711 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.958859 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.959017 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.959246 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.959968 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.960159 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.960367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.960524 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.960693 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.960844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.961001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.961150 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.961348 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.961534 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.962492 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.962666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.962819 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.962968 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.963125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.963301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.963468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.963628 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.963835 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.963995 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.964179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.964354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.964354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.964685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.964685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.965279 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.965475 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.965642 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.965804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.965954 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.966111 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.966260 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.966419 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.966612 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.966767 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.966916 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.967072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.967228 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.967393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.967543 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.967701 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.967869 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.968019 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.968200 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.968365 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.968515 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.968515 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.968806 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.968956 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.969115 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.969273 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.969429 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.969719 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.969871 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.970030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.970193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.970352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.970501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.970684 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.970839 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.970988 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.971146 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.971300 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.971453 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.971611 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.971759 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.972036 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.972240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.972451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.972611 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.972761 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.972917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.973078 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.973229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.973377 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.973569 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.973733 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.973884 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.974043 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.974204 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.974353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.974353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.974645 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.974829 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.975231 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.975400 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.975558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.975715 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.975865 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.976014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.976216 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.977175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.977353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.977557 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.977755 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.977921 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.978073 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.978233 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.978382 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.978539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.978696 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.978920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.979079 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.979238 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.979415 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.979590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.979858 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.980024 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.980196 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.980365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.980515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.980672 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.980830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.981059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.981680 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.981860 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.982039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.982282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.982451 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.982614 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.982765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.982952 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.983106 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.983256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.983256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.983256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.983685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.983841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.983991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.984203 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.984386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.984539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.984688 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.984845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.984994 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.985371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.985545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.985696 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.985928 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.986086 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.986086 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.986378 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.986535 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.986704 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.986893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.987047 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.987204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.987361 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.987520 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.987677 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.987677 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.988002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.988002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.988002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.988002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.988002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.988673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.988787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.988897 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.989128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.989254 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.989367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.989477 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.989600 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.989714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.990026 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.990196 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.990348 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.990505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.990666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.990830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.991023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.991209 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.991376 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.991531 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.991679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.991838 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.991994 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.992164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.992509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.992509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.992851 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.993012 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.993163 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.993354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.993505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.993505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.993797 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.993957 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.993957 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.994255 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.994416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.994565 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.994722 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.994890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.995781 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.995955 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.996109 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.996328 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.996494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.996652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.996801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.996949 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.997107 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.997264 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.997427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.997585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.997781 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.997939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.998466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.999175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.999351 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.999351 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.999658 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.999816 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:14.999983 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.000283 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.000442 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.000592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.000749 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.000917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.001075 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.001271 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.001429 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.001653 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.001866 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.002032 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.002182 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.002379 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.002543 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.002701 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.002851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.003017 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.003192 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.003446 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.003602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.003752 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.003917 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.004075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.004274 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.004461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.004617 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.004775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.004931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.005087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.005265 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.005416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.005566 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.005956 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.006117 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.006784 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.006966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.006966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.007264 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.007421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.007571 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.007720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.007879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.008040 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.008208 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.008366 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.008516 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.008683 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.008868 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.009022 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.009171 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.010346 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.011687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.011868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.012051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.012277 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.012435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.012593 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.012750 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.012911 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.013070 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.013070 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.013353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.013665 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.014381 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.014556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.014729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.014889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.015039 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.015195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.015382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.015555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.015714 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.016166 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.016342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.016493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.016657 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.016808 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.016966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.017130 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.017279 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.017428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.017591 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.017749 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.017898 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.018048 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.018197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.018345 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.018502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.018651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.018801 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.018949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.019108 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.019257 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.019451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.019616 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.019773 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.019930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.020080 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.020336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.020618 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.020618 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.020937 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.021153 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.021308 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.021479 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.021669 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.021863 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.022025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.022176 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.022335 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.022532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.022696 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.022847 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.023003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.023153 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.023304 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.023579 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.023887 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.024044 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.024228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.024387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.024549 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.024549 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.024842 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025004 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025154 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025311 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025645 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.025903 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.026011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.026557 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.026669 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.026765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.026851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.026933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027025 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027120 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027214 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027299 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027474 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027559 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027665 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027748 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.027912 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028008 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028100 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028483 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028569 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028711 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028794 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.028867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029140 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029225 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029322 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029397 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029536 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029614 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.029966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030043 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030043 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030318 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030318 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030461 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030836 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.030941 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031028 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031194 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031279 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031371 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031456 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031615 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031708 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031811 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031896 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.031988 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032179 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032283 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032376 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032552 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032636 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032719 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032809 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.032978 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033069 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033184 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033363 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033534 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033625 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.033723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034249 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034351 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034596 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034669 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034739 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034808 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034877 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.034960 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035213 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035298 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035554 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035623 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035692 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.035937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036029 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036113 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036311 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036392 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036743 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036836 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.036920 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037018 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037144 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037144 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037385 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037477 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037562 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037717 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037805 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.037979 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038069 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038162 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038246 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038511 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038632 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038822 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.038983 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039251 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039336 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039426 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039517 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039601 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039682 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.039969 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040065 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040385 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040641 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040833 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.040925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041006 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041084 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041232 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041312 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041497 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041567 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041567 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041698 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.041798 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.042406 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.042496 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.042588 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.042673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.042764 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.042848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.042937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.042937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043276 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043733 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.043998 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044734 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044734 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044894 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.044985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045078 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045329 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045425 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.045907 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046000 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046085 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046168 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046249 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046340 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046426 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046512 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046596 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.046991 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047077 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047271 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047439 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047608 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047705 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047705 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047858 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.047949 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048041 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048124 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048462 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048552 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048643 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048727 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048818 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048910 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.048993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049065 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049220 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049304 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049407 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049765 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049837 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049906 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.049982 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050060 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050137 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050294 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050442 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050585 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.050978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051138 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051215 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051285 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051520 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051591 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051660 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051736 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051813 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051896 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.051975 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052046 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052114 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052361 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052433 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052511 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052582 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052657 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052734 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.052959 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053036 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053258 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053415 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053554 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053700 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053781 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053781 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053914 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.053914 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054047 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054118 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054271 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054351 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054441 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054514 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054674 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054752 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.054831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055092 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055183 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055257 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055437 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055513 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055582 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055660 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055817 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.055973 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056045 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056045 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056474 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056554 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056554 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056744 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.056923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.057002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.057074 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.057149 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.057227 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.057306 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.057390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.057492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.057603 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058190 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058355 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058434 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058434 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058567 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058637 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058791 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058862 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.058938 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059032 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059116 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059301 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059385 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059474 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059564 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059731 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059907 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.059996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060079 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060183 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060458 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060655 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060834 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.060931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061108 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061273 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061356 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061544 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061630 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061712 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.061864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062176 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062262 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062358 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062443 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062608 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062689 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062821 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.062927 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063097 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063359 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.063621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064009 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064222 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064452 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064851 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.064937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065037 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065265 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065359 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065444 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065537 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065623 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065713 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065798 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065798 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.065966 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066051 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066134 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066225 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066317 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066579 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066661 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066744 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066826 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.066916 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067009 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067146 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067239 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067408 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067504 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067589 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067673 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067806 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.067918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068016 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068115 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068218 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068385 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068553 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.068922 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069202 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069286 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069459 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069595 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069698 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069876 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.069959 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070042 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070216 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070300 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070383 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070473 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070564 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070825 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.070914 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071089 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071411 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071587 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071669 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.071942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072025 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072025 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072225 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072506 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072597 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072689 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072873 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.072971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073328 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073515 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073599 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073682 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073892 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.073997 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.074078 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.074156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.074227 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.074302 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.074399 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.074485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.074699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.074792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.075027 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.075127 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.075347 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.075450 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.075682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.075783 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.076009 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.076102 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.076369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.076588 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.076681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.076920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 21:39:15.077019 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.077273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.077615 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.077953 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.078284 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.078605 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.079345 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.079345 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.079560 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.079882 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.080254 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.080554 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.080873 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.081197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.081521 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.081841 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.082164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.082482 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.082823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.083142 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.083461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.083778 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.084151 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.084447 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.084764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.085083 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.085412 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.085719 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.086034 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.086359 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.086677 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.087001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.087319 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.087645 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.088005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.088375 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.088696 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.089040 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.089372 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.089795 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.090138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.090467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.090793 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.091156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.091489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.092049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.092430 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.092767 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.093115 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.093461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.093782 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.094103 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.094425 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.094762 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.095085 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.095409 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.095732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.096054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.096406 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.096731 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.097051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.097378 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.097701 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.098023 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.098344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.098666 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.098987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.099306 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.099629 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.099991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.100355 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.100686 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.101068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.101340 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.101663 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.101986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.102307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.102631 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.102959 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.103306 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.103630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.103947 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.104953 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.105285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.105619 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.105954 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.106277 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.106614 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.106953 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.109890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.109890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.109890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.109890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.109890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.109890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.109890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.109890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.110433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.110433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.110568 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.111202 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.111202 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.111461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.111752 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.112075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.112421 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.112740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.113054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.113372 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.114093 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.114093 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.114331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.114607 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.115003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.115283 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.115598 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.115925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.116274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.116598 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.116967 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.117284 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.117637 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.118008 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.118390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.118729 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.119077 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.119399 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.119723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.120103 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.120987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.121342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.121764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.122033 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.122395 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.122719 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.123044 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.123369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.123728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.124004 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.124354 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.124695 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.125031 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.125367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.125686 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.126013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.126345 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.126673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.126992 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.127332 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.127653 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.127976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.128323 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.128645 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.128966 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.129309 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.129621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.129941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.130269 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.130600 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.130937 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.131272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.131595 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.131931 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.132295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.132656 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.132981 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.133337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.133675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.134001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.134326 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.134642 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:39:15.134896 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 21:39:15.139019 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO dbcounter [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Registered counter for database nova_api Aug 02 21:39:15.159973 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_db.sqlalchemy.engines [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:39:15.166784 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writer thread running {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:39:15.197308 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO dbcounter [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Registered counter for database nova_api Aug 02 21:39:15.218441 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_db.sqlalchemy.engines [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:39:15.222480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.context [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78522f80-8c08-462b-a516-27a7c611540e(cell1) {{(pid=124839) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 21:39:15.225054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writer thread running {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:39:15.226647 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:39:15.228299 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:39:15.229113 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:39:15.231143 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:39:15.233148 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO dbcounter [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Registered counter for database nova_cell0 Aug 02 21:39:15.237247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO dbcounter [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Registered counter for database nova_cell1 Aug 02 21:39:15.244715 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_db.sqlalchemy.engines [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:39:15.247386 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_db.sqlalchemy.engines [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:39:15.251947 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writer thread running {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:39:15.283914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.context [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78522f80-8c08-462b-a516-27a7c611540e(cell1) {{(pid=124840) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 21:39:15.288095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:39:15.289727 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:39:15.290543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:39:15.292593 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:39:15.294561 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO dbcounter [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Registered counter for database nova_cell0 Aug 02 21:39:15.298555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO dbcounter [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Registered counter for database nova_cell1 Aug 02 21:39:15.305824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_db.sqlalchemy.engines [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:39:15.308159 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_db.sqlalchemy.engines [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:39:15.312714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writer thread running {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:39:15.315833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writer thread running {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:39:15.393189 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writer thread running {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:39:15.404037 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO dbcounter [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Registered counter for database nova_cell0 Aug 02 21:39:15.410896 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_db.sqlalchemy.engines [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:39:15.415225 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writer thread running {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:39:15.464478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO dbcounter [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Registered counter for database nova_cell0 Aug 02 21:39:15.471138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_db.sqlalchemy.engines [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:39:15.475486 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writer thread running {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:39:15.734933 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: WARNING keystonemiddleware.auth_token [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 21:39:15.742278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: WARNING keystonemiddleware.auth_token [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 21:39:15.794455 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: WARNING keystonemiddleware.auth_token [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 21:39:15.801872 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: WARNING keystonemiddleware.auth_token [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 21:39:16.113217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: WARNING keystonemiddleware.auth_token [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 21:39:16.122423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: WARNING keystonemiddleware.auth_token [None req-1973d202-ef2e-49c8-b10f-ca95869ba8f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 21:39:16.128991 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584f0f299c0 pid: 124839 (default app) Aug 02 21:39:16.146513 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: WARNING keystonemiddleware.auth_token [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 21:39:16.153100 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: WARNING keystonemiddleware.auth_token [None req-aba54cd3-9a6d-4d01-9e9a-072277ff374d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 21:39:16.158725 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584f0f299c0 pid: 124840 (default app) Aug 02 21:39:57.332396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:57.332396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:57.332396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:57.332396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:58.345758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-62fe5590-b0e6-4dd7-919f-017a59937c22 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Action: 'create', calling method: .version_select at 0x7ff558f0fee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-143787463"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:39:59.381218 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-62fe5590-b0e6-4dd7-919f-017a59937c22 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.065554 Aug 02 21:39:59.382360 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Tue Aug 2 21:39:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2068 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 21:39:59.663489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1b84baee-80ba-419e-b22e-9475b8783e95 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558d93d30>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:39:59.782909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1b84baee-80ba-419e-b22e-9475b8783e95 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/4b7445b8-9871-40cd-98df-b57968da80f5" status: 200 len: 350 microversion: 2.1 time: 0.124552 Aug 02 21:39:59.783666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 2/2] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:39:59 2022] GET /compute/v2.1/os-volumes/4b7445b8-9871-40cd-98df-b57968da80f5 => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:39:59.812165 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9021c40d-d8fd-4e3f-b8f1-8ce44543d1e1 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558feba60>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:39:59.841295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:59.842798 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:59.843848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:59.845697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:00.376409 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9021c40d-d8fd-4e3f-b8f1-8ce44543d1e1 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 200 len: 345 microversion: 2.1 time: 0.982532 Aug 02 21:40:00.388204 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:39:59 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 345 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:00.390208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9979e344-f2f1-4f26-9c6d-2378d954f48d tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Action: 'create', calling method: .version_select at 0x7ff558da3430>, body: {"snapshot": {"volume_id": "ff483888-d7c5-4470-bef8-d893198ad494", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1889537781"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:01.032358 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9979e344-f2f1-4f26-9c6d-2378d954f48d tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.645113 Aug 02 21:40:01.044031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 3/4] 10.222.0.57 () {60 vars in 1162 bytes} [Tue Aug 2 21:40:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:01.047225 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-30a0bbc9-00b7-4497-8ecd-c5cd3336e2f2 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558e41d30>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:01.148664 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-30a0bbc9-00b7-4497-8ecd-c5cd3336e2f2 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.107612 Aug 02 21:40:01.151398 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 2/5] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:01 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:01.163954 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b3d1460f-7e97-4d91-9cc9-c2a343a6f903 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558da84c0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:01.309767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b3d1460f-7e97-4d91-9cc9-c2a343a6f903 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.149533 Aug 02 21:40:01.318374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 4/6] 10.222.0.57 () {58 vars in 1140 bytes} [Tue Aug 2 21:40:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:01.322179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7644abae-6e92-473a-bfe3-5d58cf3c94f1 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558e41b80>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:01.697676 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7644abae-6e92-473a-bfe3-5d58cf3c94f1 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.379865 Aug 02 21:40:01.698629 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:01 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:01.986877 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-931415f8-0765-4c28-86b9-f9e4358f6dc7 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558da3310>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:02.067794 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-931415f8-0765-4c28-86b9-f9e4358f6dc7 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a6931991-da01-4abe-b2be-02687facb19b" status: 200 len: 350 microversion: 2.1 time: 0.125766 Aug 02 21:40:02.068849 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:01 2022] GET /compute/v2.1/os-volumes/a6931991-da01-4abe-b2be-02687facb19b => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:02.710930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-af3c0664-e061-469e-bf91-e37374e3bfae tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558d8d550>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:02.751240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-af3c0664-e061-469e-bf91-e37374e3bfae tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.043760 Aug 02 21:40:02.752361 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 4/9] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:02 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:03.766070 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ea173e6c-57c6-4b6e-9b60-0128d3ebc70c tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558d93c10>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:03.857114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ea173e6c-57c6-4b6e-9b60-0128d3ebc70c tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.094824 Aug 02 21:40:03.881770 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 6/10] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:03 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:04.888982 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e4f4c951-613f-44ce-90fe-82c7987905e2 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558d8dc10>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:04.942725 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e4f4c951-613f-44ce-90fe-82c7987905e2 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.057581 Aug 02 21:40:04.943282 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 5/11] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:04 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:05.955800 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6b8d8c19-d337-49c4-a7b8-18e18e4363d5 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558da8040>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:06.007251 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6b8d8c19-d337-49c4-a7b8-18e18e4363d5 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.056067 Aug 02 21:40:06.012665 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 7/12] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:05 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:07.026391 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-96388596-3111-4834-a4d8-c8121a09d985 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558d9b310>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:07.076005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-96388596-3111-4834-a4d8-c8121a09d985 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.053866 Aug 02 21:40:07.076604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:07 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:08.089226 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a6218822-0f1d-41be-801f-b8762143bfdb tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558da3280>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:08.237810 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a6218822-0f1d-41be-801f-b8762143bfdb tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 288 microversion: 2.1 time: 0.152866 Aug 02 21:40:08.238533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 8/14] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:08 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 288 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:08.251274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ad94dc75-74cc-4366-bd0c-f67e18214c0e tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558e41e50>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:08.379877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ad94dc75-74cc-4366-bd0c-f67e18214c0e tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 202 len: 0 microversion: 2.1 time: 0.132953 Aug 02 21:40:08.380508 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 7/15] 10.222.0.57 () {58 vars in 1254 bytes} [Tue Aug 2 21:40:08 2022] DELETE /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:40:08.389275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-37f9884d-ef6e-4dfa-86f9-054f96f26a52 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558da3940>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:08.461032 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-37f9884d-ef6e-4dfa-86f9-054f96f26a52 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.075623 Aug 02 21:40:08.461664 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:08 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:40:08.840371 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fe66db7a-efd9-47b7-8a9b-fc0a9b7a9bea tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'create', calling method: .version_select at 0x7ff558d9b0d0>, body: {"keypair": {"name": "tempest-keypair-1422581794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDs3KRhp/OGgFM9HpYDdj/KIAVByvICdqK2Qrgt0P0J3v5GYzPq28Wz0+C+yE/m/MecN8bJq6NjNE+jFtxgAOEVYhwqPPkeXCZXpG29IhC8FroQDlH/ma55lyzrhGUoIQ=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:08.947689 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-fe66db7a-efd9-47b7-8a9b-fc0a9b7a9bea tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Getting quotas for project 6c98a5a02318476daf8318190d7e1a76. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:40:08.957353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-fe66db7a-efd9-47b7-8a9b-fc0a9b7a9bea tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Getting quotas for user 3d13a56d271447bb936cea12e693b22f and project 6c98a5a02318476daf8318190d7e1a76. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:40:09.064946 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fe66db7a-efd9-47b7-8a9b-fc0a9b7a9bea tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.357917 Aug 02 21:40:09.075551 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 8/17] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:40:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:09.473989 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-da53c6bb-3378-4f3e-a7f8-effac2bb0ec0 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff559718160>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:09.536956 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-da53c6bb-3378-4f3e-a7f8-effac2bb0ec0 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 200 len: 287 microversion: 2.1 time: 0.066694 Aug 02 21:40:09.545692 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 10/18] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:09 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:10.422435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a9177829-9699-4f56-a1dd-f01af3f47a98 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff55852f430>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:10.541483 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a9177829-9699-4f56-a1dd-f01af3f47a98 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5cef0c95-811d-4fd0-8d0f-b0aaa194213a" status: 200 len: 351 microversion: 2.1 time: 0.128016 Aug 02 21:40:10.542448 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 9/19] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:10 2022] GET /compute/v2.1/os-volumes/5cef0c95-811d-4fd0-8d0f-b0aaa194213a => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:10.550666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-69403108-10a3-4a61-894d-b7f93f54be86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558da8ca0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:10.555457 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5a51a2f8-8976-4952-84cd-e67b5e69a929 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff55852fa60>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:10.609882 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-69403108-10a3-4a61-894d-b7f93f54be86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] HTTP exception thrown: Snapshot b0a292ee-4408-4628-81d4-071e50eca71b could not be found. Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-69403108-10a3-4a61-894d-b7f93f54be86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Request method failure captured: Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b HTTP/1.1 Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zmt3FOIiV8GpNjWeI4WqzE1km3RyuxEA6wEbzbjdyvh02l4586TDUUGSUrt34G53ncBtR5WaaRE_tJhxmf82n6AYE_x5EOMomCwrw2vua1H0pro1Rr250K_AVWsXus-gFIyf1rJoVTIR-Xa6IqJK2NNr7nNncQUvTMfozkGtZseDGA Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 3028ae6ba7df458080081ede634e4102 Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:40:10.614389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3028ae6ba7df458080081ede634e4102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3028ae6ba7df458080081ede634e4102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3028ae6ba7df458080081ede634e4102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3028ae6ba7df458080081ede634e4102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 3028ae6ba7df458080081ede634e4102 Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesSnapshotsTestJSON-1594063361-project Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 5f42e0111be048048bf3a0aa33e4ede9 Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1594063361-project Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Snapshot b0a292ee-4408-4628-81d4-071e50eca71b could not be found. Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'b0a292ee-4408-4628-81d4-071e50eca71b'} Aug 02 21:40:10.615602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b0a292ee-4408-4628-81d4-071e50eca71b could not be found. (HTTP 404) (Request-ID: req-7dd6b39b-6919-4a83-bb51-bb08858d9f66) Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:40:10.616343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:40:10.617384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b0a292ee-4408-4628-81d4-071e50eca71b could not be found. Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 21:40:10.618374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b0a292ee-4408-4628-81d4-071e50eca71b could not be found. Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b0a292ee-4408-4628-81d4-071e50eca71b could not be found. Aug 02 21:40:10.619480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:40:10.621161 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-69403108-10a3-4a61-894d-b7f93f54be86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Returning 404 to user: Snapshot b0a292ee-4408-4628-81d4-071e50eca71b could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:40:10.628481 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-69403108-10a3-4a61-894d-b7f93f54be86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b" status: 404 len: 111 microversion: 2.1 time: 0.075356 Aug 02 21:40:10.634928 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 11/20] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:40:10 2022] GET /compute/v2.1/os-snapshots/b0a292ee-4408-4628-81d4-071e50eca71b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:40:10.651228 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-41f22c62-0422-4b2b-a2dc-2117b65176bc tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558da8dc0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:10.827417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5a51a2f8-8976-4952-84cd-e67b5e69a929 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.276270 Aug 02 21:40:10.833941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 10/21] 10.222.0.57 () {58 vars in 1134 bytes} [Tue Aug 2 21:40:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:10.843240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ff240110-5046-4759-a188-3409fc94c2fb tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558d749d0>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:10.844504 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-41f22c62-0422-4b2b-a2dc-2117b65176bc tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 202 len: 0 microversion: 2.1 time: 0.203085 Aug 02 21:40:10.845564 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 12/22] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:40:10 2022] DELETE /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:40:10.858313 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-da20671f-a2d3-4801-aa7d-6a9c7654b66a tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558f0fee0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:11.078667 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-da20671f-a2d3-4801-aa7d-6a9c7654b66a tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 200 len: 344 microversion: 2.1 time: 0.228756 Aug 02 21:40:11.079422 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 13/23] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:10 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 344 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:11.147877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ff240110-5046-4759-a188-3409fc94c2fb tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.309584 Aug 02 21:40:11.149556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 11/24] 10.222.0.57 () {58 vars in 1149 bytes} [Tue Aug 2 21:40:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:40:11.163856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-652fde7d-8659-4f51-8dbe-d6eb3e714218 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558da8b80>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:11.407180 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-52f6039c-9c5b-415e-b457-c5183ea81965 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: .version_select at 0x7ff5585381f0>, body: {"keypair": {"name": "tempest-keypair-598388876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWsLB+sV0iz2ORaeC67wsdJMRGQ3SHO263t1fv5364FdHN1C00CmvFmrpZA6A7pjXdfS7wnnhIR+jsODQmw1IA+3g+oVAfLf0ZtE7+anVr/vOMxEGitxLa4SwukAwwhXA=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:11.432051 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-652fde7d-8659-4f51-8dbe-d6eb3e714218 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.272356 Aug 02 21:40:11.432868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 14/25] 10.222.0.57 () {58 vars in 1134 bytes} [Tue Aug 2 21:40:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:11.448554 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-62e76e44-2493-4d7f-a3d3-70c25e128315 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558d18820>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:11.449773 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-52f6039c-9c5b-415e-b457-c5183ea81965 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for project c63bab062a6e4225a462ac0265535d16. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:40:11.471625 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-52f6039c-9c5b-415e-b457-c5183ea81965 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for user e477f5953a534355b29c071086846ff6 and project c63bab062a6e4225a462ac0265535d16. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:40:11.553018 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-52f6039c-9c5b-415e-b457-c5183ea81965 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.316264 Aug 02 21:40:11.560589 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 12/26] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:40:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:11.681301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-62e76e44-2493-4d7f-a3d3-70c25e128315 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.237977 Aug 02 21:40:11.682276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 15/27] 10.222.0.57 () {58 vars in 1167 bytes} [Tue Aug 2 21:40:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:11.697882 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-200d9411-adc8-47d2-b675-a1203dee0dbc tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558d18c10>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:11.746490 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-95808008", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "networks": [{"uuid": "93773d48-2bec-4975-9533-b45d789768b7"}]}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:11.880966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-200d9411-adc8-47d2-b675-a1203dee0dbc tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.187567 Aug 02 21:40:11.881533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 16/28] 10.222.0.57 () {58 vars in 1170 bytes} [Tue Aug 2 21:40:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:40:11.896638 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7733d0aa-a729-40e3-8585-05a6e867efc6 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558da8c10>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:11.975964 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] validate_networks() for [('93773d48-2bec-4975-9533-b45d789768b7', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:40:12.087481 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7733d0aa-a729-40e3-8585-05a6e867efc6 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.195799 Aug 02 21:40:12.088058 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 17/29] 10.222.0.57 () {58 vars in 1155 bytes} [Tue Aug 2 21:40:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:12.092628 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-95a74b22-fb85-4894-9ad8-d21d52e50180 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558d12550>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:12.207064 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-95a74b22-fb85-4894-9ad8-d21d52e50180 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 200 len: 344 microversion: 2.1 time: 0.117944 Aug 02 21:40:12.207711 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 18/30] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:12 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:12.217558 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-294c3cb7-f476-437e-8e71-8f9910f8ad84 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558d93e50>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:12.354483 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-294c3cb7-f476-437e-8e71-8f9910f8ad84 tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.140527 Aug 02 21:40:12.355566 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 19/31] 10.222.0.57 () {58 vars in 1188 bytes} [Tue Aug 2 21:40:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:12.372689 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2cbc681c-7cb0-4a3a-b6d0-dc6cda4617ac tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] Calling method '.version_select at 0x7ff558d18160>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:12.552851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2cbc681c-7cb0-4a3a-b6d0-dc6cda4617ac tempest-VolumesTestJSON-817537090 tempest-VolumesTestJSON-817537090-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.188059 Aug 02 21:40:12.553430 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 20/32] 10.222.0.57 () {58 vars in 1155 bytes} [Tue Aug 2 21:40:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:12.903087 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f4d8b093-6432-42bf-8fac-06b5cdede281 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'create', calling method: .version_select at 0x7ff558d12310>, body: {"keypair": {"name": "tempest-keypair-694019276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCsgdhJGyAmdxSLwgYFp5gh/3W7jL3z2ftduvEi9ZcLEwF9kBLdLCI+VvYlqawg2OkcNFH+QolESeB8KVK8TnmQh+H5W1FK2BL1sVuqNztVWL9WNYbjeOR274DDQBpNUg=="}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:13.011966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-f4d8b093-6432-42bf-8fac-06b5cdede281 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Getting quotas for project 522def96635b48a59492fb7083c3c842. Resources: {'key_pairs'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:40:13.021287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-f4d8b093-6432-42bf-8fac-06b5cdede281 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Getting quotas for user 57e8eced4d8d49458668a52761e9b8bb and project 522def96635b48a59492fb7083c3c842. Resources: {'key_pairs'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:40:13.107354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f4d8b093-6432-42bf-8fac-06b5cdede281 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.287665 Aug 02 21:40:13.108723 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 21/33] 10.222.0.57 () {62 vars in 1200 bytes} [Tue Aug 2 21:40:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 290 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 02 21:40:13.224566 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1a90c12e-1dfa-4292-98ad-23e8924d2613 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff5584a2160>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:13.321709 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1a90c12e-1dfa-4292-98ad-23e8924d2613 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 200 len: 344 microversion: 2.1 time: 0.104232 Aug 02 21:40:13.329375 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 22/34] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:13 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 344 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:14.334879 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-139109f8-1fc9-43b7-9f16-ef10b5c5af9a tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff5584a2820>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:14.486561 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-139109f8-1fc9-43b7-9f16-ef10b5c5af9a tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 200 len: 344 microversion: 2.1 time: 0.155547 Aug 02 21:40:14.494901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 23/35] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:14 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:40:14.753177 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-875330399", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72820f4b-3c99-4043-9068-d2cbe0570412"}], "security_groups": [{"name": "tempest-securitygroup--1477377057"}], "key_name": "tempest-keypair-1422581794", "user_data": "}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:14.929054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:40:14.931458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:40:14.932222 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:40:14.932831 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:40:14.933442 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:40:14.959527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:14.962245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:14.969020 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:14.969869 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:15.018644 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Getting quotas for project 80128fa0bb36449682b56634f82e78b2. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:40:15.029091 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Getting quotas for user 4e09723da5824c2e8d7321d84a4b6bf4 and project 80128fa0bb36449682b56634f82e78b2. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:40:15.045217 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:40:15.048253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:40:15.196150 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0b51c8bd-226a-4974-a3f6-f328c59f3682 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.579332 Aug 02 21:40:15.197075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 13/36] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:40:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:40:15.211569 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-904b341b-d4d7-4046-b07d-6c00297caccf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:15.212502 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-904b341b-d4d7-4046-b07d-6c00297caccf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:15.252839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] validate_networks() for [('72820f4b-3c99-4043-9068-d2cbe0570412', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:40:15.814793 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-904b341b-d4d7-4046-b07d-6c00297caccf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:15.837634 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-904b341b-d4d7-4046-b07d-6c00297caccf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1213 microversion: 2.1 time: 0.631881 Aug 02 21:40:15.841064 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 14/37] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:15 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1213 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:15.857228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c093c8af-169b-41cf-b90b-90e9f7c52e8d tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff55852f670>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:16.014360 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c093c8af-169b-41cf-b90b-90e9f7c52e8d tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 200 len: 344 microversion: 2.1 time: 0.171309 Aug 02 21:40:16.021952 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 15/38] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:15 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:16.467292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-237777459", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92813ce4-bf95-437e-8aa3-661473d14931"}], "security_groups": [{"name": "tempest-securitygroup--792141834"}], "key_name": "tempest-keypair-694019276", "user_data": "}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:16.691964 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] validate_networks() for [('92813ce4-bf95-437e-8aa3-661473d14931', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:40:17.525977 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:40:17.527120 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:40:17.528213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:40:17.528779 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:40:17.530319 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:40:17.530891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:40:17.531785 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:40:17.532673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:40:17.533322 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:40:17.537727 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:40:17.545229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:17.545878 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:17.546864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:17.547474 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:17.556663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:17.557128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:17.558088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:17.558540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:17.577155 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Getting quotas for project 522def96635b48a59492fb7083c3c842. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:40:17.586539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Getting quotas for project 6c98a5a02318476daf8318190d7e1a76. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:40:17.588840 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Getting quotas for user 57e8eced4d8d49458668a52761e9b8bb and project 522def96635b48a59492fb7083c3c842. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:40:17.591046 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Getting quotas for user 3d13a56d271447bb936cea12e693b22f and project 6c98a5a02318476daf8318190d7e1a76. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:40:17.603695 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:40:17.606521 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:40:17.607406 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:40:17.611262 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:40:17.674090 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3217de72-a4f1-4435-904b-9c46248c61a9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.211478 Aug 02 21:40:17.674861 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 16/39] 10.222.0.57 () {62 vars in 1188 bytes} [Tue Aug 2 21:40:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 21:40:17.684579 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-909380702", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d6d25b-0453-4cac-840b-702ab041b963"}], "security_groups": [{"name": "tempest-securitygroup--222152104"}], "key_name": "tempest-keypair-598388876", "user_data": "}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:17.700905 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f5da89e5-dc36-41cf-bbd5-40ea6fedeb8e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.952483 Aug 02 21:40:17.702036 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 24/40] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:40:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:40:17.713341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5cc045d1-6efa-4f0a-b1b1-738b55c7a5cb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:17.715683 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5cc045d1-6efa-4f0a-b1b1-738b55c7a5cb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:17.762472 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5cc045d1-6efa-4f0a-b1b1-738b55c7a5cb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:17.763489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5cc045d1-6efa-4f0a-b1b1-738b55c7a5cb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:17.764497 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5cc045d1-6efa-4f0a-b1b1-738b55c7a5cb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:17.765124 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5cc045d1-6efa-4f0a-b1b1-738b55c7a5cb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:17.909877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] validate_networks() for [('93d6d25b-0453-4cac-840b-702ab041b963', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:40:17.974880 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5cc045d1-6efa-4f0a-b1b1-738b55c7a5cb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:18.001356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5cc045d1-6efa-4f0a-b1b1-738b55c7a5cb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1209 microversion: 2.1 time: 0.297577 Aug 02 21:40:18.005003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 25/41] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:17 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1209 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:18.011101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-523c22bc-2fc6-44b5-8556-599a8566d6bc tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff5583ca700>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:18.167884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-523c22bc-2fc6-44b5-8556-599a8566d6bc tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 200 len: 344 microversion: 2.1 time: 0.161171 Aug 02 21:40:18.171194 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 26/42] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:18 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:18.188216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2093b0e6-0a73-4dfe-9f9c-9de6df3f3e14 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:18.203082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2093b0e6-0a73-4dfe-9f9c-9de6df3f3e14 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:18.348532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2093b0e6-0a73-4dfe-9f9c-9de6df3f3e14 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:18.363365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2093b0e6-0a73-4dfe-9f9c-9de6df3f3e14 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:18.366609 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2093b0e6-0a73-4dfe-9f9c-9de6df3f3e14 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:18.368947 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2093b0e6-0a73-4dfe-9f9c-9de6df3f3e14 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1280 microversion: 2.20 time: 0.195358 Aug 02 21:40:18.387946 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 27/43] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:18 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:18.411629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-efd53d5e-9de4-4159-9cca-ebe6412d4ef4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:18.419380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-efd53d5e-9de4-4159-9cca-ebe6412d4ef4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:18.585415 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-efd53d5e-9de4-4159-9cca-ebe6412d4ef4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:18.594361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-efd53d5e-9de4-4159-9cca-ebe6412d4ef4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1237 microversion: 2.1 time: 0.194646 Aug 02 21:40:18.595788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 28/44] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:18 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1237 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:18.915240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:40:18.915749 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:40:18.916255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:40:18.917562 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:40:18.918145 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:40:18.937544 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:18.938274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:18.940458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:18.941325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:18.963591 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for project c63bab062a6e4225a462ac0265535d16. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:40:18.968895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for user e477f5953a534355b29c071086846ff6 and project c63bab062a6e4225a462ac0265535d16. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:40:18.983596 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:40:18.985846 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:40:19.030802 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-902eae1b-5895-4f63-9495-5852652933d4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:19.031493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-902eae1b-5895-4f63-9495-5852652933d4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:19.040815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f67536ea-263f-4dac-b1e3-8c6b3797ee46 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.364692 Aug 02 21:40:19.041858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-902eae1b-5895-4f63-9495-5852652933d4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:19.044405 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-902eae1b-5895-4f63-9495-5852652933d4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:19.045326 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-902eae1b-5895-4f63-9495-5852652933d4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:19.045794 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-902eae1b-5895-4f63-9495-5852652933d4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:19.047934 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 17/45] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:40:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:40:19.053454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-69b9e29b-13e9-496f-8d22-8b5e550b1d60 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:19.054083 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-69b9e29b-13e9-496f-8d22-8b5e550b1d60 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:19.228197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-69b9e29b-13e9-496f-8d22-8b5e550b1d60 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:19.243535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-69b9e29b-13e9-496f-8d22-8b5e550b1d60 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1240 microversion: 2.1 time: 0.189349 Aug 02 21:40:19.248919 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-902eae1b-5895-4f63-9495-5852652933d4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:19.278837 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 18/46] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:19 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1240 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:19.291589 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-902eae1b-5895-4f63-9495-5852652933d4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1271 microversion: 2.1 time: 0.258978 Aug 02 21:40:19.292633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 29/47] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:19 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:19.299131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-48f40040-8bce-4101-9d0b-48336ad4f711 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff558410e50>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:19.417627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:19.420342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:19.435845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:19.436341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:19.437125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:19.448463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:19.499482 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-48f40040-8bce-4101-9d0b-48336ad4f711 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] HTTP exception thrown: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-48f40040-8bce-4101-9d0b-48336ad4f711 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Request method failure captured: Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 HTTP/1.1 Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zmt3FOIiV8GpNjWeI4WqzE1km3RyuxEA6wEbzbjdyvh02l4586TDUUGSUrt34G53ncBtR5WaaRE_tJhxmf82n6AYE_x5EOMomCwrw2vua1H0pro1Rr250K_AVWsXus-gFIyf1rJoVTIR-Xa6IqJK2NNr7nNncQUvTMfozkGtZseDGA Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 3028ae6ba7df458080081ede634e4102 Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:40:19.504046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3028ae6ba7df458080081ede634e4102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3028ae6ba7df458080081ede634e4102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3028ae6ba7df458080081ede634e4102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3028ae6ba7df458080081ede634e4102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 3028ae6ba7df458080081ede634e4102 Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-VolumesSnapshotsTestJSON-1594063361-project Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 5f42e0111be048048bf3a0aa33e4ede9 Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1594063361-project Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'ff483888-d7c5-4470-bef8-d893198ad494'} Aug 02 21:40:19.505195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. (HTTP 404) (Request-ID: req-a36cb879-2e54-4e5c-be49-cfe14541b4ef) Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.505895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:40:19.506921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 21:40:19.507965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-48f40040-8bce-4101-9d0b-48336ad4f711 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Returning 404 to user: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:40:19.508885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-48f40040-8bce-4101-9d0b-48336ad4f711 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 404 len: 109 microversion: 2.1 time: 0.219864 Aug 02 21:40:19.516700 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 19/48] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:19 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 109 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:40:19.527758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c00419bc-b00f-45df-aaab-9d305845cbb4 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff5597171f0>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:19.614125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:19.626199 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:19.633547 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:19.635387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d46d9baa-f6b9-417c-9fee-74498b2fba08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1276 microversion: 2.20 time: 0.224960 Aug 02 21:40:19.644858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 30/49] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:19 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:19.644858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f41d6171-df04-4d57-83e3-b472e9764e85 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:19.645671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f41d6171-df04-4d57-83e3-b472e9764e85 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:19.654325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-c00419bc-b00f-45df-aaab-9d305845cbb4 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] HTTP exception thrown: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c00419bc-b00f-45df-aaab-9d305845cbb4 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Request method failure captured: Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: DELETE /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 HTTP/1.1 Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zmt3FOIiV8GpNjWeI4WqzE1km3RyuxEA6wEbzbjdyvh02l4586TDUUGSUrt34G53ncBtR5WaaRE_tJhxmf82n6AYE_x5EOMomCwrw2vua1H0pro1Rr250K_AVWsXus-gFIyf1rJoVTIR-Xa6IqJK2NNr7nNncQUvTMfozkGtZseDGA Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 3028ae6ba7df458080081ede634e4102 Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:40:19.656481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3028ae6ba7df458080081ede634e4102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3028ae6ba7df458080081ede634e4102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3028ae6ba7df458080081ede634e4102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3028ae6ba7df458080081ede634e4102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 3028ae6ba7df458080081ede634e4102 Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-VolumesSnapshotsTestJSON-1594063361-project Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 5f42e0111be048048bf3a0aa33e4ede9 Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1594063361-project Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'ff483888-d7c5-4470-bef8-d893198ad494'} Aug 02 21:40:19.657540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. (HTTP 404) (Request-ID: req-15efd6ae-5c76-4cf1-ae00-3cc2a64fb614) Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.658154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 21:40:19.659131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 21:40:19.660021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c00419bc-b00f-45df-aaab-9d305845cbb4 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Returning 404 to user: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c00419bc-b00f-45df-aaab-9d305845cbb4 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 404 len: 109 microversion: 2.1 time: 0.135237 Aug 02 21:40:19.662850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 20/50] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:40:19 2022] DELETE /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 21:40:19.675427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f41d6171-df04-4d57-83e3-b472e9764e85 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:19.677485 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f41d6171-df04-4d57-83e3-b472e9764e85 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:19.680718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f41d6171-df04-4d57-83e3-b472e9764e85 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:19.682500 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f41d6171-df04-4d57-83e3-b472e9764e85 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:19.687702 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-62600054-8270-4c87-9145-1de750df8c86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Calling method '.version_select at 0x7ff5584101f0>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:19.842808 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f41d6171-df04-4d57-83e3-b472e9764e85 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:19.854274 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f41d6171-df04-4d57-83e3-b472e9764e85 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1289 microversion: 2.1 time: 0.215708 Aug 02 21:40:19.854963 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 31/51] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:19 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1289 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:19.884014 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-62600054-8270-4c87-9145-1de750df8c86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] HTTP exception thrown: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-62600054-8270-4c87-9145-1de750df8c86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Request method failure captured: Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 HTTP/1.1 Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zmt3FOIiV8GpNjWeI4WqzE1km3RyuxEA6wEbzbjdyvh02l4586TDUUGSUrt34G53ncBtR5WaaRE_tJhxmf82n6AYE_x5EOMomCwrw2vua1H0pro1Rr250K_AVWsXus-gFIyf1rJoVTIR-Xa6IqJK2NNr7nNncQUvTMfozkGtZseDGA Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 3028ae6ba7df458080081ede634e4102 Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:40:19.886545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3028ae6ba7df458080081ede634e4102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3028ae6ba7df458080081ede634e4102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3028ae6ba7df458080081ede634e4102"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3028ae6ba7df458080081ede634e4102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 3028ae6ba7df458080081ede634e4102 Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1594063361 Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-VolumesSnapshotsTestJSON-1594063361-project Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 5f42e0111be048048bf3a0aa33e4ede9 Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1594063361-project Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'ff483888-d7c5-4470-bef8-d893198ad494'} Aug 02 21:40:19.887572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. (HTTP 404) (Request-ID: req-344f878b-de80-4e8f-b9af-91310e25dfe3) Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.888272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:40:19.889649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 21:40:19.890604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-62600054-8270-4c87-9145-1de750df8c86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] Returning 404 to user: Volume ff483888-d7c5-4470-bef8-d893198ad494 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-62600054-8270-4c87-9145-1de750df8c86 tempest-VolumesSnapshotsTestJSON-1594063361 tempest-VolumesSnapshotsTestJSON-1594063361-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494" status: 404 len: 109 microversion: 2.1 time: 0.220567 Aug 02 21:40:19.891925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 21/52] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:40:19 2022] GET /compute/v2.1/os-volumes/ff483888-d7c5-4470-bef8-d893198ad494 => generated 109 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:40:20.290757 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b4549d01-40ec-4cac-83cf-6840160dcb6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:20.291388 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b4549d01-40ec-4cac-83cf-6840160dcb6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:20.300534 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b4549d01-40ec-4cac-83cf-6840160dcb6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:20.300998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b4549d01-40ec-4cac-83cf-6840160dcb6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:20.301791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b4549d01-40ec-4cac-83cf-6840160dcb6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:20.302230 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b4549d01-40ec-4cac-83cf-6840160dcb6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:20.318558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8894e69e-373f-469a-885b-49d5dab34f10 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:20.321343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8894e69e-373f-469a-885b-49d5dab34f10 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:20.327856 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8894e69e-373f-469a-885b-49d5dab34f10 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:20.328460 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8894e69e-373f-469a-885b-49d5dab34f10 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:20.345118 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8894e69e-373f-469a-885b-49d5dab34f10 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:20.345697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8894e69e-373f-469a-885b-49d5dab34f10 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:20.707388 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b4549d01-40ec-4cac-83cf-6840160dcb6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:20.731102 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b4549d01-40ec-4cac-83cf-6840160dcb6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1244 microversion: 2.1 time: 0.443340 Aug 02 21:40:20.731940 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 32/53] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:20 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1244 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:20.750819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:20.755423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:20.770307 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:20.774982 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:20.777856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:20.788117 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:21.210706 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:21.224765 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:21.233186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:21.234383 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a42486ee-8a33-4a7f-906a-1b24bc51ab84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1350 microversion: 2.20 time: 0.493562 Aug 02 21:40:21.234993 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 33/54] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:20 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1350 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:21.242872 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d28ccd3e-c93f-40da-9ddb-76b457043f75 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:21.243492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d28ccd3e-c93f-40da-9ddb-76b457043f75 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:21.285680 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d28ccd3e-c93f-40da-9ddb-76b457043f75 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:21.286250 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d28ccd3e-c93f-40da-9ddb-76b457043f75 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:21.287084 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d28ccd3e-c93f-40da-9ddb-76b457043f75 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:21.287645 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d28ccd3e-c93f-40da-9ddb-76b457043f75 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:21.480793 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d28ccd3e-c93f-40da-9ddb-76b457043f75 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:21.528643 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d28ccd3e-c93f-40da-9ddb-76b457043f75 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1295 microversion: 2.1 time: 0.289887 Aug 02 21:40:21.535488 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 34/55] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:21 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1295 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:21.754163 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4c7bfe1a-5259-4c9c-b9c7-ac057ece8853 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:21.756177 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4c7bfe1a-5259-4c9c-b9c7-ac057ece8853 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:21.770824 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4c7bfe1a-5259-4c9c-b9c7-ac057ece8853 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:21.772101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4c7bfe1a-5259-4c9c-b9c7-ac057ece8853 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:21.775804 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4c7bfe1a-5259-4c9c-b9c7-ac057ece8853 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:21.776534 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4c7bfe1a-5259-4c9c-b9c7-ac057ece8853 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:21.888188 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8894e69e-373f-469a-885b-49d5dab34f10 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:21.921061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8894e69e-373f-469a-885b-49d5dab34f10 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 1.606811 Aug 02 21:40:21.927180 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 22/56] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:20 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:22.274480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:22.275252 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:22.289404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:22.291433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:22.293440 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:22.297739 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:22.493343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4c7bfe1a-5259-4c9c-b9c7-ac057ece8853 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:22.511606 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4c7bfe1a-5259-4c9c-b9c7-ac057ece8853 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1292 microversion: 2.1 time: 0.761553 Aug 02 21:40:22.514239 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 35/57] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:21 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1292 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:22.562868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7d7a30ba-9ffc-42b4-b3d2-50a71639caf0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:22.563587 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7d7a30ba-9ffc-42b4-b3d2-50a71639caf0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:22.581402 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7d7a30ba-9ffc-42b4-b3d2-50a71639caf0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:22.583027 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7d7a30ba-9ffc-42b4-b3d2-50a71639caf0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:22.586438 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7d7a30ba-9ffc-42b4-b3d2-50a71639caf0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:22.592932 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7d7a30ba-9ffc-42b4-b3d2-50a71639caf0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:22.954174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:22.971759 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:22.974277 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:22.987802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-16d3d265-4a38-4daf-a346-f7167183150a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1338 microversion: 2.20 time: 0.720793 Aug 02 21:40:22.991345 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 23/58] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:22 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1338 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:40:23.022059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ea491c12-79df-48de-ab7e-dd0031e0f360 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:23.024400 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ea491c12-79df-48de-ab7e-dd0031e0f360 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:23.035428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea491c12-79df-48de-ab7e-dd0031e0f360 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:23.053292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea491c12-79df-48de-ab7e-dd0031e0f360 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:23.056182 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea491c12-79df-48de-ab7e-dd0031e0f360 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:23.056996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea491c12-79df-48de-ab7e-dd0031e0f360 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:24.591973 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ea491c12-79df-48de-ab7e-dd0031e0f360 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:24.606360 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ea491c12-79df-48de-ab7e-dd0031e0f360 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 1.608922 Aug 02 21:40:24.607058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 24/59] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:22 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:24.625241 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7d7a30ba-9ffc-42b4-b3d2-50a71639caf0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:24.634603 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7d7a30ba-9ffc-42b4-b3d2-50a71639caf0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 2.080581 Aug 02 21:40:24.638106 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 36/60] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:22 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:24.643725 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e5625a0b-8304-4834-92fb-91373e4f6214 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:24.651333 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e5625a0b-8304-4834-92fb-91373e4f6214 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:24.651809 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:24.652918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:24.660896 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:24.664846 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e5625a0b-8304-4834-92fb-91373e4f6214 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:24.665512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:24.667140 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:24.668627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:24.668922 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e5625a0b-8304-4834-92fb-91373e4f6214 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:24.670213 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e5625a0b-8304-4834-92fb-91373e4f6214 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:24.671232 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e5625a0b-8304-4834-92fb-91373e4f6214 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:24.856647 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:24.865449 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:24.873180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:24.878380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-cff71092-c9da-4126-83b8-8e5576a3bd52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1338 microversion: 2.20 time: 0.237870 Aug 02 21:40:24.888511 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 37/61] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:24 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:25.048754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e5625a0b-8304-4834-92fb-91373e4f6214 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:25.064710 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e5625a0b-8304-4834-92fb-91373e4f6214 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1298 microversion: 2.1 time: 0.427138 Aug 02 21:40:25.070750 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 25/62] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:24 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1298 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:25.633668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a5c1dcb1-0f37-4190-81fa-c0682dafac04 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:25.634991 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a5c1dcb1-0f37-4190-81fa-c0682dafac04 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:25.673772 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-61da5158-9f27-4ee3-959f-5182374c2010 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:25.676185 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-61da5158-9f27-4ee3-959f-5182374c2010 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:25.709819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a5c1dcb1-0f37-4190-81fa-c0682dafac04 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:25.719757 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-61da5158-9f27-4ee3-959f-5182374c2010 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:25.722843 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a5c1dcb1-0f37-4190-81fa-c0682dafac04 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:25.725161 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a5c1dcb1-0f37-4190-81fa-c0682dafac04 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:25.731472 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a5c1dcb1-0f37-4190-81fa-c0682dafac04 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:25.732807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-61da5158-9f27-4ee3-959f-5182374c2010 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:25.735993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-61da5158-9f27-4ee3-959f-5182374c2010 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:25.737153 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-61da5158-9f27-4ee3-959f-5182374c2010 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:26.097874 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-61da5158-9f27-4ee3-959f-5182374c2010 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:26.110832 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-61da5158-9f27-4ee3-959f-5182374c2010 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.453612 Aug 02 21:40:26.128675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 26/63] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:25 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:26.139802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:26.140466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:26.166961 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:26.172900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:26.174246 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:26.174830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:26.558932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:26.575282 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:26.578934 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:26.583742 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7cb6a543-6baf-4942-a2e5-78b3f4aa8212 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1338 microversion: 2.20 time: 0.453702 Aug 02 21:40:26.588867 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 27/64] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:26 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1338 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:26.614238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7bd6ec44-c3c8-453f-9fd6-b08960776055 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:26.617480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7bd6ec44-c3c8-453f-9fd6-b08960776055 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:26.642137 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7bd6ec44-c3c8-453f-9fd6-b08960776055 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:26.651090 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a5c1dcb1-0f37-4190-81fa-c0682dafac04 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:26.659684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7bd6ec44-c3c8-453f-9fd6-b08960776055 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:26.661617 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a5c1dcb1-0f37-4190-81fa-c0682dafac04 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 1.032784 Aug 02 21:40:26.662679 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7bd6ec44-c3c8-453f-9fd6-b08960776055 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:26.663428 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 38/65] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:25 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:26.664098 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7bd6ec44-c3c8-453f-9fd6-b08960776055 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:27.146749 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7bd6ec44-c3c8-453f-9fd6-b08960776055 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:27.153842 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-88bc2f9a-8d87-46e3-8d08-f0bf66d9f9f8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:27.154948 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-88bc2f9a-8d87-46e3-8d08-f0bf66d9f9f8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:27.180245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7bd6ec44-c3c8-453f-9fd6-b08960776055 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1298 microversion: 2.1 time: 0.584270 Aug 02 21:40:27.181111 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 28/66] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:26 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1298 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:27.185853 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-88bc2f9a-8d87-46e3-8d08-f0bf66d9f9f8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:27.186304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-88bc2f9a-8d87-46e3-8d08-f0bf66d9f9f8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:27.189248 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-88bc2f9a-8d87-46e3-8d08-f0bf66d9f9f8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:27.193608 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-88bc2f9a-8d87-46e3-8d08-f0bf66d9f9f8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:27.578466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:27.617917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:27.618822 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:27.622030 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:27.644489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:27.645130 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:27.647256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:27.647751 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:28.440590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:28.452929 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:28.454508 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:28.455663 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f858a99e-8a8f-4f8f-a97f-dd85062c004e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.843145 Aug 02 21:40:28.456298 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 29/67] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:27 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:28.478179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-dcdcc668-1e1c-4f60-9ddf-7b42598ba0fb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:28.479182 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-dcdcc668-1e1c-4f60-9ddf-7b42598ba0fb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:28.496621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dcdcc668-1e1c-4f60-9ddf-7b42598ba0fb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:28.497583 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dcdcc668-1e1c-4f60-9ddf-7b42598ba0fb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:28.498413 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dcdcc668-1e1c-4f60-9ddf-7b42598ba0fb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:28.500054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dcdcc668-1e1c-4f60-9ddf-7b42598ba0fb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:28.597930 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=14 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:28.743404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-88bc2f9a-8d87-46e3-8d08-f0bf66d9f9f8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:28.779297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-88bc2f9a-8d87-46e3-8d08-f0bf66d9f9f8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 1.638708 Aug 02 21:40:28.783385 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 39/68] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:27 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:28.817026 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-96a9dfde-598a-4d5b-ac13-2e1417ca510a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:28.817862 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-96a9dfde-598a-4d5b-ac13-2e1417ca510a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:28.837983 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-96a9dfde-598a-4d5b-ac13-2e1417ca510a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:28.841678 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-96a9dfde-598a-4d5b-ac13-2e1417ca510a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:28.842900 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-96a9dfde-598a-4d5b-ac13-2e1417ca510a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:28.843792 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-96a9dfde-598a-4d5b-ac13-2e1417ca510a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:28.956727 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=6 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:29.235768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=30 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:29.897045 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-96a9dfde-598a-4d5b-ac13-2e1417ca510a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:29.906038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-96a9dfde-598a-4d5b-ac13-2e1417ca510a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 1.115522 Aug 02 21:40:29.909976 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 40/69] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:28 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:30.314164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-dcdcc668-1e1c-4f60-9ddf-7b42598ba0fb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:30.324268 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-dcdcc668-1e1c-4f60-9ddf-7b42598ba0fb tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 1.858907 Aug 02 21:40:30.331081 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 30/70] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:28 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:30.356273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:30.358149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:30.392997 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:30.393870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:30.396976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:30.397966 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:30.508939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-7b98b7ed-380c-42fe-9e1c-a31a12cbbf27 req-1c3f4f87-1539-4e61-8a48-2c41592b4ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29658748-1966-42f3-9fec-c72df8ee883d", "tag": "9519b829-ec58-4b2f-a032-377ada1ca4aa"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:30.566336 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7b98b7ed-380c-42fe-9e1c-a31a12cbbf27 req-1c3f4f87-1539-4e61-8a48-2c41592b4ce4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:30.569203 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7b98b7ed-380c-42fe-9e1c-a31a12cbbf27 req-1c3f4f87-1539-4e61-8a48-2c41592b4ce4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:30.658352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-7b98b7ed-380c-42fe-9e1c-a31a12cbbf27 req-1c3f4f87-1539-4e61-8a48-2c41592b4ce4 service nova] Creating event network-changed:9519b829-ec58-4b2f-a032-377ada1ca4aa for instance 29658748-1966-42f3-9fec-c72df8ee883d on hv-cinder-85144 Aug 02 21:40:30.660408 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7b98b7ed-380c-42fe-9e1c-a31a12cbbf27 req-1c3f4f87-1539-4e61-8a48-2c41592b4ce4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124839) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 21:40:30.664556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-945a3243-50d7-40ba-a274-69448e9ff4bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:30.670576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-945a3243-50d7-40ba-a274-69448e9ff4bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:30.675157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-945a3243-50d7-40ba-a274-69448e9ff4bd None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:30.677019 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-945a3243-50d7-40ba-a274-69448e9ff4bd None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:30.727469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.compute.rpcapi [None req-945a3243-50d7-40ba-a274-69448e9ff4bd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 21:40:30.728908 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-945a3243-50d7-40ba-a274-69448e9ff4bd None None] Releasing lock "compute-rpcapi-router" {{(pid=124839) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 21:40:30.768462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-945a3243-50d7-40ba-a274-69448e9ff4bd None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.855487 Aug 02 21:40:30.769929 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 41/71] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:30.798554 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ab793bae-8139-4bb6-8437-a3fb66420221 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:30.799398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ab793bae-8139-4bb6-8437-a3fb66420221 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:30.841688 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ab793bae-8139-4bb6-8437-a3fb66420221 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:30.845139 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ab793bae-8139-4bb6-8437-a3fb66420221 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:30.848124 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ab793bae-8139-4bb6-8437-a3fb66420221 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:30.849568 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ab793bae-8139-4bb6-8437-a3fb66420221 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:31.277440 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:31.298623 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:31.304596 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:31.310916 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fbfa626c-b894-459e-872d-3d6d3b3a7388 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.968526 Aug 02 21:40:31.339065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 31/72] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:30 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:31.355864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-47751caa-569b-48b7-aeca-9dc0a031abf5 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:31.356537 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-47751caa-569b-48b7-aeca-9dc0a031abf5 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:31.371180 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-47751caa-569b-48b7-aeca-9dc0a031abf5 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:31.371644 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-47751caa-569b-48b7-aeca-9dc0a031abf5 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:31.374879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-47751caa-569b-48b7-aeca-9dc0a031abf5 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:31.375369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-47751caa-569b-48b7-aeca-9dc0a031abf5 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:31.655379 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ab793bae-8139-4bb6-8437-a3fb66420221 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:31.674623 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ab793bae-8139-4bb6-8437-a3fb66420221 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.896058 Aug 02 21:40:31.676592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 42/73] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:30 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:31.687090 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7828e06e-ff9d-466e-8c1f-a2700a7b6477 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:31.691388 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7828e06e-ff9d-466e-8c1f-a2700a7b6477 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:31.726671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7828e06e-ff9d-466e-8c1f-a2700a7b6477 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:31.729762 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7828e06e-ff9d-466e-8c1f-a2700a7b6477 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:31.731715 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7828e06e-ff9d-466e-8c1f-a2700a7b6477 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:31.741845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7828e06e-ff9d-466e-8c1f-a2700a7b6477 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:32.393199 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-47751caa-569b-48b7-aeca-9dc0a031abf5 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:32.410291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-47751caa-569b-48b7-aeca-9dc0a031abf5 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 1.069785 Aug 02 21:40:32.410880 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 32/74] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:31 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:32.509154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-7e1cab09-1d24-4607-ac03-0567fbc2d968 req-29097b03-6dc0-4a16-a34f-48651cbc80d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "581dd5c7-3160-47ed-ac20-6d35cbd6604c", "tag": "1b078072-8634-47d5-b163-fe8eb6da769b"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:32.560754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-7e1cab09-1d24-4607-ac03-0567fbc2d968 req-29097b03-6dc0-4a16-a34f-48651cbc80d1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:32.561438 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-7e1cab09-1d24-4607-ac03-0567fbc2d968 req-29097b03-6dc0-4a16-a34f-48651cbc80d1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:32.574173 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7828e06e-ff9d-466e-8c1f-a2700a7b6477 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:32.584387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7828e06e-ff9d-466e-8c1f-a2700a7b6477 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.902641 Aug 02 21:40:32.586676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 43/75] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:31 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:32.606660 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:32.607539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:32.612730 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-7e1cab09-1d24-4607-ac03-0567fbc2d968 req-29097b03-6dc0-4a16-a34f-48651cbc80d1 service nova] Creating event network-changed:1b078072-8634-47d5-b163-fe8eb6da769b for instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c on hv-cinder-85144 Aug 02 21:40:32.613393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-7e1cab09-1d24-4607-ac03-0567fbc2d968 req-29097b03-6dc0-4a16-a34f-48651cbc80d1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124840) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 21:40:32.614645 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffe52c8a-573f-40ac-8f1b-fab0779b8c61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:32.615841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:32.617116 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffe52c8a-573f-40ac-8f1b-fab0779b8c61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:32.617467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:32.618390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffe52c8a-573f-40ac-8f1b-fab0779b8c61 None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:32.618527 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:32.619080 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:32.619290 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffe52c8a-573f-40ac-8f1b-fab0779b8c61 None None] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:32.645954 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.compute.rpcapi [None req-ffe52c8a-573f-40ac-8f1b-fab0779b8c61 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 21:40:32.647110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffe52c8a-573f-40ac-8f1b-fab0779b8c61 None None] Releasing lock "compute-rpcapi-router" {{(pid=124840) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 21:40:32.655465 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:32.712963 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ffe52c8a-573f-40ac-8f1b-fab0779b8c61 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297097 Aug 02 21:40:32.714920 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 33/76] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:32.726909 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-05504890-f2c1-4fc0-9121-544f33334106 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:32.743889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-05504890-f2c1-4fc0-9121-544f33334106 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:32.761339 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-05504890-f2c1-4fc0-9121-544f33334106 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:32.780965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-05504890-f2c1-4fc0-9121-544f33334106 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:32.781824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-05504890-f2c1-4fc0-9121-544f33334106 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:32.782470 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-05504890-f2c1-4fc0-9121-544f33334106 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:32.992809 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:33.017653 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:33.022915 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:33.027707 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9892da0b-e054-4369-8b2d-e579599ce671 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.439336 Aug 02 21:40:33.030575 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 44/77] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:32 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:33.142840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-d1d43d78-174f-454b-a60c-47cc5871672f req-5695bbce-d1ad-4540-b25c-ab9f5620d586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391bbb28-e679-4c38-ac7e-11c95d7a281e", "tag": "b77a9842-5391-4ffd-b917-1e0dcd38ced0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:33.184991 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-d1d43d78-174f-454b-a60c-47cc5871672f req-5695bbce-d1ad-4540-b25c-ab9f5620d586 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:33.186613 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-d1d43d78-174f-454b-a60c-47cc5871672f req-5695bbce-d1ad-4540-b25c-ab9f5620d586 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:33.204836 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-d1d43d78-174f-454b-a60c-47cc5871672f req-5695bbce-d1ad-4540-b25c-ab9f5620d586 service nova] Creating event network-changed:b77a9842-5391-4ffd-b917-1e0dcd38ced0 for instance 391bbb28-e679-4c38-ac7e-11c95d7a281e on hv-cinder-85144 Aug 02 21:40:33.211820 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-d1d43d78-174f-454b-a60c-47cc5871672f req-5695bbce-d1ad-4540-b25c-ab9f5620d586 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072414 Aug 02 21:40:33.212652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 45/78] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:40:33.305263 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-05504890-f2c1-4fc0-9121-544f33334106 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:33.313358 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-05504890-f2c1-4fc0-9121-544f33334106 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.594618 Aug 02 21:40:33.315278 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 34/79] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:32 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:33.436075 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-24115846-fc2f-4552-8648-fe7a81b876a7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:33.436354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-24115846-fc2f-4552-8648-fe7a81b876a7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:33.443547 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-24115846-fc2f-4552-8648-fe7a81b876a7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:33.444786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-24115846-fc2f-4552-8648-fe7a81b876a7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:33.445777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-24115846-fc2f-4552-8648-fe7a81b876a7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:33.446399 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-24115846-fc2f-4552-8648-fe7a81b876a7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:33.610371 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2f1f8bb8-26b7-4592-927a-1d0383be768a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:33.610988 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2f1f8bb8-26b7-4592-927a-1d0383be768a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:33.620584 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-24115846-fc2f-4552-8648-fe7a81b876a7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:33.621528 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2f1f8bb8-26b7-4592-927a-1d0383be768a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:33.623370 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2f1f8bb8-26b7-4592-927a-1d0383be768a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:33.625839 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2f1f8bb8-26b7-4592-927a-1d0383be768a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:33.626526 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2f1f8bb8-26b7-4592-927a-1d0383be768a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:33.630380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-24115846-fc2f-4552-8648-fe7a81b876a7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.199626 Aug 02 21:40:33.631136 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 46/80] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:33 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:33.784206 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2f1f8bb8-26b7-4592-927a-1d0383be768a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:33.792958 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2f1f8bb8-26b7-4592-927a-1d0383be768a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.188204 Aug 02 21:40:33.793772 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 35/81] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:33 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:34.060484 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:34.061700 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:34.068184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.068648 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.070061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.070411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.226201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:34.238147 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:34.240225 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:34.242329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-eb734373-eab1-4a9c-a42c-082ffc98d29a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.186950 Aug 02 21:40:34.243399 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 47/82] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:34 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:34.338876 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f20a3076-4fae-4a4c-8377-a74aaf25739f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:34.339695 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f20a3076-4fae-4a4c-8377-a74aaf25739f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:34.347942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f20a3076-4fae-4a4c-8377-a74aaf25739f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.348495 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f20a3076-4fae-4a4c-8377-a74aaf25739f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.349400 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f20a3076-4fae-4a4c-8377-a74aaf25739f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.349843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f20a3076-4fae-4a4c-8377-a74aaf25739f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.518427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f20a3076-4fae-4a4c-8377-a74aaf25739f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:34.527892 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f20a3076-4fae-4a4c-8377-a74aaf25739f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.195523 Aug 02 21:40:34.528507 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 36/83] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:34 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:34.653626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9e20b8e3-6f9c-41a8-8fba-c37da57a8eea tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:34.655032 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9e20b8e3-6f9c-41a8-8fba-c37da57a8eea tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:34.663542 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9e20b8e3-6f9c-41a8-8fba-c37da57a8eea tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.664864 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9e20b8e3-6f9c-41a8-8fba-c37da57a8eea tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.666013 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9e20b8e3-6f9c-41a8-8fba-c37da57a8eea tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.666626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9e20b8e3-6f9c-41a8-8fba-c37da57a8eea tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.753999 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-dc93a7ce-fdd6-425a-8254-ea4362b26d5b req-c70fd0b6-21bb-429e-96a0-ee113b21e87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffdc7be9-6b66-4157-8533-c7fedcee85cd", "tag": "e78e48c5-9b03-4f00-86f4-4b6796ab3b28"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:34.770108 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-dc93a7ce-fdd6-425a-8254-ea4362b26d5b req-c70fd0b6-21bb-429e-96a0-ee113b21e87e service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.770564 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-dc93a7ce-fdd6-425a-8254-ea4362b26d5b req-c70fd0b6-21bb-429e-96a0-ee113b21e87e service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.785774 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-dc93a7ce-fdd6-425a-8254-ea4362b26d5b req-c70fd0b6-21bb-429e-96a0-ee113b21e87e service nova] Creating event network-changed:e78e48c5-9b03-4f00-86f4-4b6796ab3b28 for instance ffdc7be9-6b66-4157-8533-c7fedcee85cd on hv-cinder-85144 Aug 02 21:40:34.793177 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-dc93a7ce-fdd6-425a-8254-ea4362b26d5b req-c70fd0b6-21bb-429e-96a0-ee113b21e87e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043483 Aug 02 21:40:34.795403 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 37/84] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:40:34.817592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2076430e-4a68-4fbd-b628-ea2bc9a1c28c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:34.818293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2076430e-4a68-4fbd-b628-ea2bc9a1c28c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:34.825145 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2076430e-4a68-4fbd-b628-ea2bc9a1c28c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.825590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2076430e-4a68-4fbd-b628-ea2bc9a1c28c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.826542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2076430e-4a68-4fbd-b628-ea2bc9a1c28c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:34.827155 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2076430e-4a68-4fbd-b628-ea2bc9a1c28c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:34.847117 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=100 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:34.966317 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9e20b8e3-6f9c-41a8-8fba-c37da57a8eea tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:34.980530 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9e20b8e3-6f9c-41a8-8fba-c37da57a8eea tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.333092 Aug 02 21:40:34.983369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 48/85] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:34 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:35.199844 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2076430e-4a68-4fbd-b628-ea2bc9a1c28c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:35.209709 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2076430e-4a68-4fbd-b628-ea2bc9a1c28c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.395433 Aug 02 21:40:35.210303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 38/86] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:34 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:35.265568 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:35.266427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:35.273127 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:35.273618 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:35.274392 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:35.279758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:35.463738 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:35.472868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:35.474680 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:35.481153 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2293415a-90ff-4452-85d8-54ec8699b11c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.219287 Aug 02 21:40:35.496373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 49/87] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:35 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:35.549807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ab38980a-a389-49b9-8092-6f6747f5037e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:35.550440 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ab38980a-a389-49b9-8092-6f6747f5037e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:35.557653 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab38980a-a389-49b9-8092-6f6747f5037e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:35.563057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab38980a-a389-49b9-8092-6f6747f5037e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:35.563897 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab38980a-a389-49b9-8092-6f6747f5037e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:35.564380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab38980a-a389-49b9-8092-6f6747f5037e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:35.792766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ab38980a-a389-49b9-8092-6f6747f5037e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:35.818780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ab38980a-a389-49b9-8092-6f6747f5037e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.272225 Aug 02 21:40:35.820278 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 39/88] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:35 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:36.000905 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0b68422c-ad1e-4a2a-b752-a487c4013d6b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:36.001736 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0b68422c-ad1e-4a2a-b752-a487c4013d6b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:36.008666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b68422c-ad1e-4a2a-b752-a487c4013d6b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:36.013047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b68422c-ad1e-4a2a-b752-a487c4013d6b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:36.014356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b68422c-ad1e-4a2a-b752-a487c4013d6b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:36.015114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b68422c-ad1e-4a2a-b752-a487c4013d6b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:36.219221 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0b68422c-ad1e-4a2a-b752-a487c4013d6b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:36.227396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0b68422c-ad1e-4a2a-b752-a487c4013d6b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.230555 Aug 02 21:40:36.228494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 50/89] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:35 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:36.245123 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-763d0190-a656-443d-93c5-feb1134b5bfe tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:36.245758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-763d0190-a656-443d-93c5-feb1134b5bfe tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:36.252401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-763d0190-a656-443d-93c5-feb1134b5bfe tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:36.253132 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-763d0190-a656-443d-93c5-feb1134b5bfe tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:36.254096 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-763d0190-a656-443d-93c5-feb1134b5bfe tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:36.254917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-763d0190-a656-443d-93c5-feb1134b5bfe tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:36.405251 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-763d0190-a656-443d-93c5-feb1134b5bfe tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:36.414642 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-763d0190-a656-443d-93c5-feb1134b5bfe tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.187349 Aug 02 21:40:36.415190 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 40/90] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:36 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:36.515247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:36.516398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:36.524420 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:36.524999 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:36.525882 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:36.526432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:36.689970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:36.698471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:36.700125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:36.701659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0ea7364c-6d30-4812-931e-58f31538cb6c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.195527 Aug 02 21:40:36.702522 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 51/91] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:36 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:36.842913 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-677c8113-a526-437a-a1a0-1bf1ca65e8aa tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:36.843537 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-677c8113-a526-437a-a1a0-1bf1ca65e8aa tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:36.849771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-677c8113-a526-437a-a1a0-1bf1ca65e8aa tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:36.850268 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-677c8113-a526-437a-a1a0-1bf1ca65e8aa tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:36.851044 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-677c8113-a526-437a-a1a0-1bf1ca65e8aa tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:36.851672 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-677c8113-a526-437a-a1a0-1bf1ca65e8aa tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:37.028471 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-677c8113-a526-437a-a1a0-1bf1ca65e8aa tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:37.036403 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-677c8113-a526-437a-a1a0-1bf1ca65e8aa tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.198588 Aug 02 21:40:37.037316 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 41/92] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:36 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:37.249999 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d7880c8c-d537-427c-9a47-efedec9306cc tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:37.250720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d7880c8c-d537-427c-9a47-efedec9306cc tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:37.258965 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d7880c8c-d537-427c-9a47-efedec9306cc tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:37.259628 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d7880c8c-d537-427c-9a47-efedec9306cc tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:37.260671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d7880c8c-d537-427c-9a47-efedec9306cc tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:37.261204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d7880c8c-d537-427c-9a47-efedec9306cc tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:37.404531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d7880c8c-d537-427c-9a47-efedec9306cc tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:37.412959 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d7880c8c-d537-427c-9a47-efedec9306cc tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.166983 Aug 02 21:40:37.413526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 52/93] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:37 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:37.435735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7b1d65bf-0e6e-4dff-bb11-8066eecfaf40 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:37.436431 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7b1d65bf-0e6e-4dff-bb11-8066eecfaf40 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:37.446902 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b1d65bf-0e6e-4dff-bb11-8066eecfaf40 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:37.447364 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b1d65bf-0e6e-4dff-bb11-8066eecfaf40 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:37.448169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b1d65bf-0e6e-4dff-bb11-8066eecfaf40 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:37.448611 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b1d65bf-0e6e-4dff-bb11-8066eecfaf40 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:37.592420 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7b1d65bf-0e6e-4dff-bb11-8066eecfaf40 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:37.603429 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7b1d65bf-0e6e-4dff-bb11-8066eecfaf40 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.171399 Aug 02 21:40:37.604469 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 42/94] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:37 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:37.724488 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:37.725639 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:37.731565 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:37.732002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:37.732954 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:37.733393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:37.867240 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:37.877197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:37.878720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:37.879859 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0eb6d0a6-1777-4ce7-a6ed-bc64123e8496 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.159163 Aug 02 21:40:37.880497 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 53/95] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:37 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:38.057555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f05ca654-f266-4db1-8115-90d37d3e0744 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:38.058116 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f05ca654-f266-4db1-8115-90d37d3e0744 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:38.063949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f05ca654-f266-4db1-8115-90d37d3e0744 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:38.064440 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f05ca654-f266-4db1-8115-90d37d3e0744 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:38.065212 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f05ca654-f266-4db1-8115-90d37d3e0744 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:38.065653 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f05ca654-f266-4db1-8115-90d37d3e0744 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:38.198108 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f05ca654-f266-4db1-8115-90d37d3e0744 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:38.205774 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f05ca654-f266-4db1-8115-90d37d3e0744 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.152066 Aug 02 21:40:38.216212 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 43/96] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:38 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:38.434424 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2270688b-6a06-4744-ac0e-1934f66c3d12 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:38.435052 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2270688b-6a06-4744-ac0e-1934f66c3d12 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:38.437187 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:38.444191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2270688b-6a06-4744-ac0e-1934f66c3d12 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:38.444660 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2270688b-6a06-4744-ac0e-1934f66c3d12 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:38.445444 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2270688b-6a06-4744-ac0e-1934f66c3d12 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:38.445890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2270688b-6a06-4744-ac0e-1934f66c3d12 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:38.574102 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2270688b-6a06-4744-ac0e-1934f66c3d12 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:38.582734 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2270688b-6a06-4744-ac0e-1934f66c3d12 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.152159 Aug 02 21:40:38.583310 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 54/97] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:38 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:38.625082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0812a128-14bb-4b68-b2a4-ba0329081428 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:38.625926 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0812a128-14bb-4b68-b2a4-ba0329081428 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:38.632414 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0812a128-14bb-4b68-b2a4-ba0329081428 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:38.632932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0812a128-14bb-4b68-b2a4-ba0329081428 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:38.633735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0812a128-14bb-4b68-b2a4-ba0329081428 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:38.634134 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0812a128-14bb-4b68-b2a4-ba0329081428 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:38.824019 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0812a128-14bb-4b68-b2a4-ba0329081428 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:38.831567 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0812a128-14bb-4b68-b2a4-ba0329081428 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.210375 Aug 02 21:40:38.832155 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 44/98] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:38 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:38.903170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:38.903899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:38.910195 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:38.910726 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:38.911570 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:38.912224 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:39.123501 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:39.139372 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:39.145432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:39.147294 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5d587f56-9c58-4a63-be1e-fccfaa754d9c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.248435 Aug 02 21:40:39.148942 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 55/99] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:38 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:39.227165 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-843c2e8c-43a2-4582-910f-1b340cbcac44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:39.228010 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-843c2e8c-43a2-4582-910f-1b340cbcac44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:39.234973 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-843c2e8c-43a2-4582-910f-1b340cbcac44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:39.235514 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-843c2e8c-43a2-4582-910f-1b340cbcac44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:39.236402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-843c2e8c-43a2-4582-910f-1b340cbcac44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:39.236845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-843c2e8c-43a2-4582-910f-1b340cbcac44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:39.385260 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-843c2e8c-43a2-4582-910f-1b340cbcac44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:39.393225 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-843c2e8c-43a2-4582-910f-1b340cbcac44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.170670 Aug 02 21:40:39.393867 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 45/100] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:39 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:39.603027 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-95332166-0c71-479f-a90a-530e7244e7bb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:39.603646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-95332166-0c71-479f-a90a-530e7244e7bb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:39.610223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95332166-0c71-479f-a90a-530e7244e7bb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:39.610794 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95332166-0c71-479f-a90a-530e7244e7bb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:39.611570 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95332166-0c71-479f-a90a-530e7244e7bb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:39.612027 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95332166-0c71-479f-a90a-530e7244e7bb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:39.853800 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-826d1e95-1893-4bf4-853b-e5d1f72edc23 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:39.854573 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-826d1e95-1893-4bf4-853b-e5d1f72edc23 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:39.860764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-826d1e95-1893-4bf4-853b-e5d1f72edc23 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:39.861132 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-826d1e95-1893-4bf4-853b-e5d1f72edc23 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:39.861890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-826d1e95-1893-4bf4-853b-e5d1f72edc23 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:39.862321 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-826d1e95-1893-4bf4-853b-e5d1f72edc23 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:39.968456 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-95332166-0c71-479f-a90a-530e7244e7bb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:39.977629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-95332166-0c71-479f-a90a-530e7244e7bb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.378278 Aug 02 21:40:39.978295 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 56/101] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:39 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:40.015096 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-826d1e95-1893-4bf4-853b-e5d1f72edc23 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:40.023819 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-826d1e95-1893-4bf4-853b-e5d1f72edc23 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.174492 Aug 02 21:40:40.024431 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 46/102] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:39 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:40.178984 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:40.179676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:40.187516 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:40.188155 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:40.189005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:40.189511 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:40.384926 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:40.394679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:40.398451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:40.399965 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-787e4bb8-f830-43af-92e3-7f9a2a87cc8e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.225775 Aug 02 21:40:40.401059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 57/103] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:40 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:40.424794 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-40a2be75-2186-4654-b0d4-a314e0a7d3ad tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:40.424794 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-40a2be75-2186-4654-b0d4-a314e0a7d3ad tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:40.429880 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-40a2be75-2186-4654-b0d4-a314e0a7d3ad tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:40.430344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-40a2be75-2186-4654-b0d4-a314e0a7d3ad tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:40.431290 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-40a2be75-2186-4654-b0d4-a314e0a7d3ad tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:40.431737 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-40a2be75-2186-4654-b0d4-a314e0a7d3ad tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:40.571523 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-40a2be75-2186-4654-b0d4-a314e0a7d3ad tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:40.579716 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-40a2be75-2186-4654-b0d4-a314e0a7d3ad tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.161597 Aug 02 21:40:40.580827 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 47/104] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:40 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:40.998203 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3b6f2b9a-b8a9-428a-9b7c-c7298fc3cab0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:40.998841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3b6f2b9a-b8a9-428a-9b7c-c7298fc3cab0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:41.002030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:41.006204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3b6f2b9a-b8a9-428a-9b7c-c7298fc3cab0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:41.007513 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3b6f2b9a-b8a9-428a-9b7c-c7298fc3cab0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:41.008337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3b6f2b9a-b8a9-428a-9b7c-c7298fc3cab0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:41.008777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3b6f2b9a-b8a9-428a-9b7c-c7298fc3cab0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:41.045244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ae027ed2-e410-4d9f-98f9-3908cf3d7be3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:41.045978 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ae027ed2-e410-4d9f-98f9-3908cf3d7be3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:41.053848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae027ed2-e410-4d9f-98f9-3908cf3d7be3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:41.054386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae027ed2-e410-4d9f-98f9-3908cf3d7be3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:41.055293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae027ed2-e410-4d9f-98f9-3908cf3d7be3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:41.055807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae027ed2-e410-4d9f-98f9-3908cf3d7be3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:41.212603 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3b6f2b9a-b8a9-428a-9b7c-c7298fc3cab0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:41.225777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3b6f2b9a-b8a9-428a-9b7c-c7298fc3cab0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.231323 Aug 02 21:40:41.226810 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 58/105] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:40 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:41.270939 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ae027ed2-e410-4d9f-98f9-3908cf3d7be3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:41.279952 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ae027ed2-e410-4d9f-98f9-3908cf3d7be3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.238990 Aug 02 21:40:41.280865 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 48/106] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:41 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:41.423526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:41.424246 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:41.434920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:41.435544 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:41.436503 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:41.437095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:41.602597 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6b6ae81d-8c54-44c9-ae4a-ba0fa75d69be tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:41.603310 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6b6ae81d-8c54-44c9-ae4a-ba0fa75d69be tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:41.616504 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6b6ae81d-8c54-44c9-ae4a-ba0fa75d69be tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:41.616993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6b6ae81d-8c54-44c9-ae4a-ba0fa75d69be tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:41.617824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6b6ae81d-8c54-44c9-ae4a-ba0fa75d69be tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:41.618263 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6b6ae81d-8c54-44c9-ae4a-ba0fa75d69be tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:41.629194 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:41.639741 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:41.641479 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:41.642632 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-fba1bec6-63bd-45a8-82ed-a4130139b829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.223058 Aug 02 21:40:41.643191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 59/107] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:41 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:41.814331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6b6ae81d-8c54-44c9-ae4a-ba0fa75d69be tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:41.825408 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6b6ae81d-8c54-44c9-ae4a-ba0fa75d69be tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.227149 Aug 02 21:40:41.825996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 49/108] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:41 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:42.253774 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b7634b76-494f-4ee8-8d2c-cd835d862252 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:42.255002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b7634b76-494f-4ee8-8d2c-cd835d862252 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:42.261140 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7634b76-494f-4ee8-8d2c-cd835d862252 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:42.261847 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7634b76-494f-4ee8-8d2c-cd835d862252 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:42.262814 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7634b76-494f-4ee8-8d2c-cd835d862252 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:42.263446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7634b76-494f-4ee8-8d2c-cd835d862252 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:42.301944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-19dd6471-2915-4a2e-9992-61e45c546823 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:42.302976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-19dd6471-2915-4a2e-9992-61e45c546823 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:42.314571 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19dd6471-2915-4a2e-9992-61e45c546823 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:42.315500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19dd6471-2915-4a2e-9992-61e45c546823 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:42.317528 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19dd6471-2915-4a2e-9992-61e45c546823 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:42.318582 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19dd6471-2915-4a2e-9992-61e45c546823 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:42.429333 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b7634b76-494f-4ee8-8d2c-cd835d862252 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:42.436696 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b7634b76-494f-4ee8-8d2c-cd835d862252 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.186734 Aug 02 21:40:42.437268 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 60/109] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:42 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:42.488039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-19dd6471-2915-4a2e-9992-61e45c546823 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:42.496239 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-19dd6471-2915-4a2e-9992-61e45c546823 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.198405 Aug 02 21:40:42.497188 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 50/110] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:42 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:42.665967 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:42.666495 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:42.672508 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:42.673123 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:42.673998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:42.674445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:42.824438 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:42.827899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:42.834585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:42.836084 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:42.837377 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e0d63acf-ab18-430f-84ae-7f6957fca2c1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.175471 Aug 02 21:40:42.837925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 61/111] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:42 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:42.847836 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a938c552-66fa-4495-aa79-818e97b50ff9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:42.849192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a938c552-66fa-4495-aa79-818e97b50ff9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:42.851774 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:42.857362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a938c552-66fa-4495-aa79-818e97b50ff9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:42.857819 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a938c552-66fa-4495-aa79-818e97b50ff9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:42.858583 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a938c552-66fa-4495-aa79-818e97b50ff9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:42.859157 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a938c552-66fa-4495-aa79-818e97b50ff9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:43.008630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a938c552-66fa-4495-aa79-818e97b50ff9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:43.015817 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a938c552-66fa-4495-aa79-818e97b50ff9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.173685 Aug 02 21:40:43.016414 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 51/112] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:42 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:43.457648 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4610cdf6-16f9-4388-bc2c-1a502f48b249 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:43.458269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4610cdf6-16f9-4388-bc2c-1a502f48b249 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:43.465199 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4610cdf6-16f9-4388-bc2c-1a502f48b249 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:43.465657 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4610cdf6-16f9-4388-bc2c-1a502f48b249 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:43.466590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4610cdf6-16f9-4388-bc2c-1a502f48b249 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:43.467026 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4610cdf6-16f9-4388-bc2c-1a502f48b249 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:43.519092 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e21ac36a-9c94-4f4d-859a-257f0c8e2e9d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:43.519702 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e21ac36a-9c94-4f4d-859a-257f0c8e2e9d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:43.525932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e21ac36a-9c94-4f4d-859a-257f0c8e2e9d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:43.526507 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e21ac36a-9c94-4f4d-859a-257f0c8e2e9d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:43.527532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e21ac36a-9c94-4f4d-859a-257f0c8e2e9d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:43.527967 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e21ac36a-9c94-4f4d-859a-257f0c8e2e9d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:43.617535 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4610cdf6-16f9-4388-bc2c-1a502f48b249 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:43.625659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4610cdf6-16f9-4388-bc2c-1a502f48b249 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.171881 Aug 02 21:40:43.626497 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 62/113] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:43 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:43.680466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e21ac36a-9c94-4f4d-859a-257f0c8e2e9d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:43.688334 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e21ac36a-9c94-4f4d-859a-257f0c8e2e9d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.173054 Aug 02 21:40:43.688910 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 52/114] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:43 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:43.860768 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:43.861462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:43.868025 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:43.868502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:43.869270 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:43.869708 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:44.036207 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7f542973-a8af-4fcd-862c-985318e43541 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:44.036846 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7f542973-a8af-4fcd-862c-985318e43541 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:44.043618 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f542973-a8af-4fcd-862c-985318e43541 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:44.044071 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f542973-a8af-4fcd-862c-985318e43541 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:44.044880 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f542973-a8af-4fcd-862c-985318e43541 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:44.045904 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f542973-a8af-4fcd-862c-985318e43541 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:44.063923 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:44.072216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:44.073760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:44.074926 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3bde19e9-b9bf-4b60-bc45-9b6128f84d13 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.218303 Aug 02 21:40:44.075656 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 63/115] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:43 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:44.183273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7f542973-a8af-4fcd-862c-985318e43541 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:44.191011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7f542973-a8af-4fcd-862c-985318e43541 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.158685 Aug 02 21:40:44.191857 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 53/116] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:44 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:44.645899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-31595a11-600a-45f3-96ae-eea61d4ff2d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:44.647668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-31595a11-600a-45f3-96ae-eea61d4ff2d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:44.655148 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-31595a11-600a-45f3-96ae-eea61d4ff2d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:44.655830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-31595a11-600a-45f3-96ae-eea61d4ff2d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:44.656646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-31595a11-600a-45f3-96ae-eea61d4ff2d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:44.657282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-31595a11-600a-45f3-96ae-eea61d4ff2d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:44.710227 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-248ce3b3-a636-414c-8719-22400b756aaf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:44.711011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-248ce3b3-a636-414c-8719-22400b756aaf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:44.718329 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-248ce3b3-a636-414c-8719-22400b756aaf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:44.718862 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-248ce3b3-a636-414c-8719-22400b756aaf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:44.719732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-248ce3b3-a636-414c-8719-22400b756aaf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:44.720293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-248ce3b3-a636-414c-8719-22400b756aaf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:44.800889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-31595a11-600a-45f3-96ae-eea61d4ff2d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:44.807298 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-31595a11-600a-45f3-96ae-eea61d4ff2d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.165375 Aug 02 21:40:44.808190 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 64/117] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:44 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:44.870044 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-248ce3b3-a636-414c-8719-22400b756aaf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:44.878980 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-248ce3b3-a636-414c-8719-22400b756aaf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.173704 Aug 02 21:40:44.879853 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 54/118] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:44 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:45.097820 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:45.098440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:45.106375 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:45.107180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:45.108209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:45.109232 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:45.214591 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-81e17cf7-4bc6-48ad-92aa-d941522ae2ca tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:45.215241 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-81e17cf7-4bc6-48ad-92aa-d941522ae2ca tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:45.222013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81e17cf7-4bc6-48ad-92aa-d941522ae2ca tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:45.222523 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81e17cf7-4bc6-48ad-92aa-d941522ae2ca tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:45.223318 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81e17cf7-4bc6-48ad-92aa-d941522ae2ca tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:45.223766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81e17cf7-4bc6-48ad-92aa-d941522ae2ca tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:45.228316 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=100 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:45.259374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:45.268505 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:45.270003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:45.271109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-cbeffc61-63d7-44b5-a5ad-1a3fd1747f02 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.177433 Aug 02 21:40:45.272626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 65/119] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:45 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:45.414912 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-81e17cf7-4bc6-48ad-92aa-d941522ae2ca tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:45.423929 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-81e17cf7-4bc6-48ad-92aa-d941522ae2ca tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.214440 Aug 02 21:40:45.424540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 55/120] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:45 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:45.829055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f28e32da-06e8-4a46-b2a7-b11d18e3a2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:45.829787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f28e32da-06e8-4a46-b2a7-b11d18e3a2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:45.836236 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f28e32da-06e8-4a46-b2a7-b11d18e3a2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:45.836683 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f28e32da-06e8-4a46-b2a7-b11d18e3a2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:45.837452 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f28e32da-06e8-4a46-b2a7-b11d18e3a2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:45.837888 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f28e32da-06e8-4a46-b2a7-b11d18e3a2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:45.902255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1e0e09b0-d2ae-4399-b01a-4e9e169ee043 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:45.902571 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1e0e09b0-d2ae-4399-b01a-4e9e169ee043 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:45.909285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1e0e09b0-d2ae-4399-b01a-4e9e169ee043 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:45.909800 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1e0e09b0-d2ae-4399-b01a-4e9e169ee043 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:45.910874 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1e0e09b0-d2ae-4399-b01a-4e9e169ee043 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:45.911485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1e0e09b0-d2ae-4399-b01a-4e9e169ee043 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:45.978136 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f28e32da-06e8-4a46-b2a7-b11d18e3a2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:45.985499 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f28e32da-06e8-4a46-b2a7-b11d18e3a2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.160446 Aug 02 21:40:45.986061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 66/121] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:45 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:46.047423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1e0e09b0-d2ae-4399-b01a-4e9e169ee043 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:46.055986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1e0e09b0-d2ae-4399-b01a-4e9e169ee043 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.159332 Aug 02 21:40:46.056592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 56/122] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:45 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:46.298962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:46.299504 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:46.305595 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:46.306039 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:46.306796 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:46.307226 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:46.446125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ff63ba2c-6a0a-4ae8-9a77-3cc2b9f540d1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:46.446622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:46.446904 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ff63ba2c-6a0a-4ae8-9a77-3cc2b9f540d1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:46.453337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ff63ba2c-6a0a-4ae8-9a77-3cc2b9f540d1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:46.453992 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ff63ba2c-6a0a-4ae8-9a77-3cc2b9f540d1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:46.454606 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:46.454936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ff63ba2c-6a0a-4ae8-9a77-3cc2b9f540d1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:46.455459 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ff63ba2c-6a0a-4ae8-9a77-3cc2b9f540d1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:46.456349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:46.457490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8859758f-4686-4e24-88b7-fc3f80bad3ba tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.162539 Aug 02 21:40:46.458209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 67/123] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:46 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:46.600924 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ff63ba2c-6a0a-4ae8-9a77-3cc2b9f540d1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:46.608439 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ff63ba2c-6a0a-4ae8-9a77-3cc2b9f540d1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.166269 Aug 02 21:40:46.609011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 57/124] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:46 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:47.006119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c96dfd23-9612-4ae1-9162-c661d2b04c77 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:47.006737 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c96dfd23-9612-4ae1-9162-c661d2b04c77 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:47.012818 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c96dfd23-9612-4ae1-9162-c661d2b04c77 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:47.013265 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c96dfd23-9612-4ae1-9162-c661d2b04c77 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:47.014031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c96dfd23-9612-4ae1-9162-c661d2b04c77 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:47.014460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c96dfd23-9612-4ae1-9162-c661d2b04c77 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:47.077083 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b11131c9-9edf-438a-a382-ad0296875eb4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:47.077824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b11131c9-9edf-438a-a382-ad0296875eb4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:47.085002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b11131c9-9edf-438a-a382-ad0296875eb4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:47.085579 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b11131c9-9edf-438a-a382-ad0296875eb4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:47.086547 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b11131c9-9edf-438a-a382-ad0296875eb4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:47.087057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b11131c9-9edf-438a-a382-ad0296875eb4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:47.152261 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c96dfd23-9612-4ae1-9162-c661d2b04c77 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:47.159896 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c96dfd23-9612-4ae1-9162-c661d2b04c77 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.157596 Aug 02 21:40:47.160987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 68/125] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:47 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:47.233543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b11131c9-9edf-438a-a382-ad0296875eb4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:47.241065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b11131c9-9edf-438a-a382-ad0296875eb4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.168023 Aug 02 21:40:47.241633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 58/126] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:47 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:47.484016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:47.484016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:47.486947 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:47.487393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:47.488186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:47.488627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:47.624975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:47.629193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-73f6e175-22e6-441e-b9f0-5ca47ce47f8a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:47.629856 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-73f6e175-22e6-441e-b9f0-5ca47ce47f8a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:47.634295 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:47.635783 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:47.636506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-73f6e175-22e6-441e-b9f0-5ca47ce47f8a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:47.636912 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7a40aae0-94da-4b90-aa29-60fb98648ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.160496 Aug 02 21:40:47.637018 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-73f6e175-22e6-441e-b9f0-5ca47ce47f8a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:47.648165 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 69/127] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:47 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:47.648303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-73f6e175-22e6-441e-b9f0-5ca47ce47f8a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:47.648303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-73f6e175-22e6-441e-b9f0-5ca47ce47f8a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:47.790790 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-73f6e175-22e6-441e-b9f0-5ca47ce47f8a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:47.798589 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-73f6e175-22e6-441e-b9f0-5ca47ce47f8a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.173508 Aug 02 21:40:47.799157 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 59/128] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:47 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:48.181697 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5781d09c-0c76-415b-ada2-c6a6e0ac2f6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:48.182314 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5781d09c-0c76-415b-ada2-c6a6e0ac2f6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:48.188660 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5781d09c-0c76-415b-ada2-c6a6e0ac2f6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:48.189115 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5781d09c-0c76-415b-ada2-c6a6e0ac2f6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:48.189892 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5781d09c-0c76-415b-ada2-c6a6e0ac2f6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:48.190332 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5781d09c-0c76-415b-ada2-c6a6e0ac2f6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:48.261277 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-38182569-167a-46ff-af14-82ccf522a78c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:48.261897 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-38182569-167a-46ff-af14-82ccf522a78c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:48.270954 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-38182569-167a-46ff-af14-82ccf522a78c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:48.271535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-38182569-167a-46ff-af14-82ccf522a78c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:48.272787 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-38182569-167a-46ff-af14-82ccf522a78c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:48.273133 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-38182569-167a-46ff-af14-82ccf522a78c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:48.326524 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5781d09c-0c76-415b-ada2-c6a6e0ac2f6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:48.334187 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5781d09c-0c76-415b-ada2-c6a6e0ac2f6d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.156944 Aug 02 21:40:48.334925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 70/129] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:48 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:48.421468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-38182569-167a-46ff-af14-82ccf522a78c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:48.429016 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-38182569-167a-46ff-af14-82ccf522a78c tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.171566 Aug 02 21:40:48.429925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 60/130] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:48 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:48.665005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:48.665626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:48.671868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:48.672362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:48.673143 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:48.673583 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:48.816916 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:48.820388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-dee3acde-a57d-48d1-9689-974d8d6c2f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:48.822111 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-dee3acde-a57d-48d1-9689-974d8d6c2f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:48.825872 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:48.827771 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:48.829080 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-38a836ef-2be9-4793-baf8-6e87967528e1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.168840 Aug 02 21:40:48.829480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dee3acde-a57d-48d1-9689-974d8d6c2f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:48.829626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 71/131] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:48 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:48.829942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dee3acde-a57d-48d1-9689-974d8d6c2f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:48.830710 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dee3acde-a57d-48d1-9689-974d8d6c2f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:48.831293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dee3acde-a57d-48d1-9689-974d8d6c2f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:48.963498 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-dee3acde-a57d-48d1-9689-974d8d6c2f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:48.971149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-dee3acde-a57d-48d1-9689-974d8d6c2f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.155314 Aug 02 21:40:48.971894 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 61/132] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:48 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:49.354920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f6a87b8e-dcac-4cf5-bc30-8172fcabd09e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:49.355536 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f6a87b8e-dcac-4cf5-bc30-8172fcabd09e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:49.362131 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f6a87b8e-dcac-4cf5-bc30-8172fcabd09e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:49.362612 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f6a87b8e-dcac-4cf5-bc30-8172fcabd09e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:49.363769 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f6a87b8e-dcac-4cf5-bc30-8172fcabd09e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:49.364233 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f6a87b8e-dcac-4cf5-bc30-8172fcabd09e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:49.449866 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-80ce246c-95ea-45f0-8776-2c027be8ba9b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:49.450488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-80ce246c-95ea-45f0-8776-2c027be8ba9b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:49.456860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-80ce246c-95ea-45f0-8776-2c027be8ba9b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:49.457547 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-80ce246c-95ea-45f0-8776-2c027be8ba9b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:49.458369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-80ce246c-95ea-45f0-8776-2c027be8ba9b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:49.459020 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-80ce246c-95ea-45f0-8776-2c027be8ba9b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:49.504682 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f6a87b8e-dcac-4cf5-bc30-8172fcabd09e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:49.515050 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f6a87b8e-dcac-4cf5-bc30-8172fcabd09e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.163904 Aug 02 21:40:49.515933 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 72/133] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:49 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:49.606513 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-80ce246c-95ea-45f0-8776-2c027be8ba9b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:49.614558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-80ce246c-95ea-45f0-8776-2c027be8ba9b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.168442 Aug 02 21:40:49.615179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 62/134] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:49 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:49.852638 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:49.853257 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:49.859167 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:49.859613 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:49.860398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:49.860830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:49.991493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d2a92bca-2b4f-4c67-820f-6848596aa4f6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:49.992727 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d2a92bca-2b4f-4c67-820f-6848596aa4f6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:49.998784 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d2a92bca-2b4f-4c67-820f-6848596aa4f6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:49.999434 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d2a92bca-2b4f-4c67-820f-6848596aa4f6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:50.000397 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d2a92bca-2b4f-4c67-820f-6848596aa4f6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:50.000831 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d2a92bca-2b4f-4c67-820f-6848596aa4f6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:50.019917 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:50.029529 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:50.033151 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:50.034471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-66628e03-8fc2-4cb4-b808-4590c9afd35d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.186519 Aug 02 21:40:50.035647 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 73/135] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:49 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:50.149101 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d2a92bca-2b4f-4c67-820f-6848596aa4f6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:50.156845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d2a92bca-2b4f-4c67-820f-6848596aa4f6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.169184 Aug 02 21:40:50.157498 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 63/136] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:49 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:50.537332 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0943a1b1-a346-41e5-8b35-6b748ed54b93 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:50.538107 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0943a1b1-a346-41e5-8b35-6b748ed54b93 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:50.544605 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0943a1b1-a346-41e5-8b35-6b748ed54b93 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:50.545051 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0943a1b1-a346-41e5-8b35-6b748ed54b93 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:50.545820 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0943a1b1-a346-41e5-8b35-6b748ed54b93 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:50.546318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0943a1b1-a346-41e5-8b35-6b748ed54b93 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:50.638032 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-484e7acc-f1c2-4846-8535-d07ed86086b1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:50.639201 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-484e7acc-f1c2-4846-8535-d07ed86086b1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:50.648038 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-484e7acc-f1c2-4846-8535-d07ed86086b1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:50.648977 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-484e7acc-f1c2-4846-8535-d07ed86086b1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:50.650704 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-484e7acc-f1c2-4846-8535-d07ed86086b1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:50.651287 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-484e7acc-f1c2-4846-8535-d07ed86086b1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:50.697167 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0943a1b1-a346-41e5-8b35-6b748ed54b93 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:50.705096 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0943a1b1-a346-41e5-8b35-6b748ed54b93 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.171839 Aug 02 21:40:50.720030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 74/137] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:50 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:50.824737 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-484e7acc-f1c2-4846-8535-d07ed86086b1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:50.833111 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-484e7acc-f1c2-4846-8535-d07ed86086b1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.198947 Aug 02 21:40:50.834011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 64/138] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:50 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:51.061131 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:51.062641 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:51.072819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.073550 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.074780 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.075356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.181826 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-893fee84-f940-469d-808e-de6a69a80459 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:51.182504 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-893fee84-f940-469d-808e-de6a69a80459 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:51.196471 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-893fee84-f940-469d-808e-de6a69a80459 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.197345 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-893fee84-f940-469d-808e-de6a69a80459 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.198396 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-893fee84-f940-469d-808e-de6a69a80459 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.199379 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-893fee84-f940-469d-808e-de6a69a80459 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.305918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:51.321223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:51.322939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:51.324327 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4a044110-05fa-40e4-8cc9-4820c5f107f7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.268763 Aug 02 21:40:51.339532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 75/139] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:51 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:51.634750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-228ad2fd-a337-4a13-b0c1-f554ac20b074 req-caf0c152-2755-41a1-ab3c-646c554d9f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391bbb28-e679-4c38-ac7e-11c95d7a281e", "name": "network-vif-plugged", "status": "completed", "tag": "b77a9842-5391-4ffd-b917-1e0dcd38ced0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:51.644591 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-228ad2fd-a337-4a13-b0c1-f554ac20b074 req-caf0c152-2755-41a1-ab3c-646c554d9f59 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.645055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-228ad2fd-a337-4a13-b0c1-f554ac20b074 req-caf0c152-2755-41a1-ab3c-646c554d9f59 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.657511 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-228ad2fd-a337-4a13-b0c1-f554ac20b074 req-caf0c152-2755-41a1-ab3c-646c554d9f59 service nova] Creating event network-vif-plugged:b77a9842-5391-4ffd-b917-1e0dcd38ced0 for instance 391bbb28-e679-4c38-ac7e-11c95d7a281e on hv-cinder-85144 Aug 02 21:40:51.662904 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-228ad2fd-a337-4a13-b0c1-f554ac20b074 req-caf0c152-2755-41a1-ab3c-646c554d9f59 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088511 Aug 02 21:40:51.663518 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 76/140] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:40:51.693237 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-893fee84-f940-469d-808e-de6a69a80459 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:51.702258 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-893fee84-f940-469d-808e-de6a69a80459 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.525157 Aug 02 21:40:51.703380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 65/141] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:51 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:51.727770 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-50b76f17-c25e-4b5a-a534-2953714fac63 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:51.729247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-50b76f17-c25e-4b5a-a534-2953714fac63 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:51.736667 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-50b76f17-c25e-4b5a-a534-2953714fac63 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.737170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-50b76f17-c25e-4b5a-a534-2953714fac63 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.738126 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-50b76f17-c25e-4b5a-a534-2953714fac63 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.738667 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-50b76f17-c25e-4b5a-a534-2953714fac63 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.854453 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0d96fbf1-8ee9-4d2e-95a2-9c21b9d2a66d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:51.855071 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0d96fbf1-8ee9-4d2e-95a2-9c21b9d2a66d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:51.861092 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0d96fbf1-8ee9-4d2e-95a2-9c21b9d2a66d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.861552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0d96fbf1-8ee9-4d2e-95a2-9c21b9d2a66d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.862340 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0d96fbf1-8ee9-4d2e-95a2-9c21b9d2a66d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:51.862764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0d96fbf1-8ee9-4d2e-95a2-9c21b9d2a66d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:51.922506 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-50b76f17-c25e-4b5a-a534-2953714fac63 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:51.930777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-50b76f17-c25e-4b5a-a534-2953714fac63 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.207498 Aug 02 21:40:51.931512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 77/142] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:51 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:52.002638 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0d96fbf1-8ee9-4d2e-95a2-9c21b9d2a66d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:52.011463 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0d96fbf1-8ee9-4d2e-95a2-9c21b9d2a66d tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.160790 Aug 02 21:40:52.012103 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 66/143] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:51 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:52.347164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:52.347889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:52.354297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:52.354887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:52.355725 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:52.356264 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:52.509103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:52.520174 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:52.521875 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:52.523180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-142e090d-4f0d-4241-ab07-ffe003bbe328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.180343 Aug 02 21:40:52.528430 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 78/144] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:52 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:52.728873 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a2ceac75-eee3-4fbc-a65a-ec8c06117bbf tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:52.729961 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a2ceac75-eee3-4fbc-a65a-ec8c06117bbf tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:52.736576 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a2ceac75-eee3-4fbc-a65a-ec8c06117bbf tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:52.737035 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a2ceac75-eee3-4fbc-a65a-ec8c06117bbf tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:52.737815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a2ceac75-eee3-4fbc-a65a-ec8c06117bbf tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:52.738255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a2ceac75-eee3-4fbc-a65a-ec8c06117bbf tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:52.937620 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a2ceac75-eee3-4fbc-a65a-ec8c06117bbf tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:52.945610 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a2ceac75-eee3-4fbc-a65a-ec8c06117bbf tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.226005 Aug 02 21:40:52.946193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 67/145] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:52 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:52.952374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c1f555a5-33d7-4a40-9021-e47259acfa78 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:52.953052 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c1f555a5-33d7-4a40-9021-e47259acfa78 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:52.959981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1f555a5-33d7-4a40-9021-e47259acfa78 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:52.960359 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1f555a5-33d7-4a40-9021-e47259acfa78 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:52.961121 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1f555a5-33d7-4a40-9021-e47259acfa78 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:52.961581 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1f555a5-33d7-4a40-9021-e47259acfa78 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:52.965678 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:53.033581 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-24dd020d-b823-4026-a3b6-43a44ad53445 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:53.034202 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-24dd020d-b823-4026-a3b6-43a44ad53445 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:53.041375 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-24dd020d-b823-4026-a3b6-43a44ad53445 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:53.041891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-24dd020d-b823-4026-a3b6-43a44ad53445 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:53.042887 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-24dd020d-b823-4026-a3b6-43a44ad53445 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:53.043589 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-24dd020d-b823-4026-a3b6-43a44ad53445 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:53.115276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c1f555a5-33d7-4a40-9021-e47259acfa78 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:53.125320 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c1f555a5-33d7-4a40-9021-e47259acfa78 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.176868 Aug 02 21:40:53.127297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 79/146] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:52 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:53.217434 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-24dd020d-b823-4026-a3b6-43a44ad53445 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:53.229078 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-24dd020d-b823-4026-a3b6-43a44ad53445 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.199385 Aug 02 21:40:53.229755 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 68/147] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:53 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:53.546769 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:53.547380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:53.553992 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:53.554443 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:53.555210 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:53.555647 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:53.696094 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:53.707786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:53.709402 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:53.710512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5d1f3ca4-3fc5-4564-bd3f-8b508f01aa87 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.167582 Aug 02 21:40:53.711073 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 80/148] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:53 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:53.966190 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c96bcf55-71df-4d61-b7a7-ca0031198115 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:53.966974 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c96bcf55-71df-4d61-b7a7-ca0031198115 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:53.985746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c96bcf55-71df-4d61-b7a7-ca0031198115 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:53.985746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c96bcf55-71df-4d61-b7a7-ca0031198115 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:53.985746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c96bcf55-71df-4d61-b7a7-ca0031198115 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:53.985746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c96bcf55-71df-4d61-b7a7-ca0031198115 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:54.126855 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c96bcf55-71df-4d61-b7a7-ca0031198115 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:54.134852 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c96bcf55-71df-4d61-b7a7-ca0031198115 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.172358 Aug 02 21:40:54.135448 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 69/149] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:53 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:54.149442 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d3e55a91-661b-499d-8df0-573336668582 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:54.150061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d3e55a91-661b-499d-8df0-573336668582 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:54.156538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d3e55a91-661b-499d-8df0-573336668582 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:54.156946 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d3e55a91-661b-499d-8df0-573336668582 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:54.157694 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d3e55a91-661b-499d-8df0-573336668582 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:54.158334 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d3e55a91-661b-499d-8df0-573336668582 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:54.251564 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9861f647-5fc6-4a2a-9a53-288312359a24 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:54.252307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9861f647-5fc6-4a2a-9a53-288312359a24 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:54.268983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9861f647-5fc6-4a2a-9a53-288312359a24 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:54.269445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9861f647-5fc6-4a2a-9a53-288312359a24 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:54.271577 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9861f647-5fc6-4a2a-9a53-288312359a24 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:54.273362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9861f647-5fc6-4a2a-9a53-288312359a24 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:54.325604 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d3e55a91-661b-499d-8df0-573336668582 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:54.342107 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d3e55a91-661b-499d-8df0-573336668582 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.196446 Aug 02 21:40:54.356735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 81/150] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:54 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:54.502689 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9861f647-5fc6-4a2a-9a53-288312359a24 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:54.511375 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9861f647-5fc6-4a2a-9a53-288312359a24 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.265151 Aug 02 21:40:54.513011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 70/151] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:54 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:54.735760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:54.736498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:54.743978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:54.744789 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:54.746102 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:54.746750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:55.058642 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:55.070424 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:55.074470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:55.085016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0345d314-8996-4164-9689-5d974e6ea70d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.353652 Aug 02 21:40:55.087060 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 82/152] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:54 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:55.156863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-63af4a20-2988-4dd8-b606-025d5ef3ee78 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:55.158074 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-63af4a20-2988-4dd8-b606-025d5ef3ee78 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:55.172617 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63af4a20-2988-4dd8-b606-025d5ef3ee78 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:55.173254 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63af4a20-2988-4dd8-b606-025d5ef3ee78 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:55.174333 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63af4a20-2988-4dd8-b606-025d5ef3ee78 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:55.174908 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63af4a20-2988-4dd8-b606-025d5ef3ee78 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:55.363240 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a3f86997-b708-45f5-999a-aa54a3b46d1b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:55.364607 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a3f86997-b708-45f5-999a-aa54a3b46d1b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:55.372349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a3f86997-b708-45f5-999a-aa54a3b46d1b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:55.373101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a3f86997-b708-45f5-999a-aa54a3b46d1b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:55.374667 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a3f86997-b708-45f5-999a-aa54a3b46d1b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:55.375641 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a3f86997-b708-45f5-999a-aa54a3b46d1b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:55.431039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-63af4a20-2988-4dd8-b606-025d5ef3ee78 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:55.435148 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=100 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:55.440241 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-63af4a20-2988-4dd8-b606-025d5ef3ee78 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.287968 Aug 02 21:40:55.444352 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 71/153] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:55 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:55.540082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-24a1e923-dacf-47f1-a09e-a6b281131976 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:55.543616 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-24a1e923-dacf-47f1-a09e-a6b281131976 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:55.555175 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-24a1e923-dacf-47f1-a09e-a6b281131976 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:55.556957 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-24a1e923-dacf-47f1-a09e-a6b281131976 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:55.560655 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-24a1e923-dacf-47f1-a09e-a6b281131976 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:55.561303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-24a1e923-dacf-47f1-a09e-a6b281131976 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:55.605038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a3f86997-b708-45f5-999a-aa54a3b46d1b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:55.616829 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a3f86997-b708-45f5-999a-aa54a3b46d1b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.257435 Aug 02 21:40:55.617722 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 83/154] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:55 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:55.633887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-6c83f937-6742-4914-96ae-9955a5f67fd2 req-f349cc3f-21c7-4431-aa9e-4eeda9caa4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "581dd5c7-3160-47ed-ac20-6d35cbd6604c", "name": "network-vif-plugged", "status": "completed", "tag": "1b078072-8634-47d5-b163-fe8eb6da769b"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:40:55.649103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-6c83f937-6742-4914-96ae-9955a5f67fd2 req-f349cc3f-21c7-4431-aa9e-4eeda9caa4a4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:55.651059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-6c83f937-6742-4914-96ae-9955a5f67fd2 req-f349cc3f-21c7-4431-aa9e-4eeda9caa4a4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:55.668411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-6c83f937-6742-4914-96ae-9955a5f67fd2 req-f349cc3f-21c7-4431-aa9e-4eeda9caa4a4 service nova] Creating event network-vif-plugged:1b078072-8634-47d5-b163-fe8eb6da769b for instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c on hv-cinder-85144 Aug 02 21:40:55.674941 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-6c83f937-6742-4914-96ae-9955a5f67fd2 req-f349cc3f-21c7-4431-aa9e-4eeda9caa4a4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056054 Aug 02 21:40:55.675848 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 84/155] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:40:55.800601 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-24a1e923-dacf-47f1-a09e-a6b281131976 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:55.815335 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-24a1e923-dacf-47f1-a09e-a6b281131976 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.283863 Aug 02 21:40:55.815920 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 72/156] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:55 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:56.112832 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:56.113539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:56.120344 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:56.120802 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:56.121718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:56.122168 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:56.263166 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:56.271782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:56.273476 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:56.274725 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d1fc1fb1-b5e1-42dc-919f-e8f682d27ad1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.166269 Aug 02 21:40:56.275423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 85/157] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:56 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:56.460829 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e8ad4da2-2254-4788-874d-8bac62dda330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:56.461450 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e8ad4da2-2254-4788-874d-8bac62dda330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:56.467796 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e8ad4da2-2254-4788-874d-8bac62dda330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:56.468078 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e8ad4da2-2254-4788-874d-8bac62dda330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:56.469321 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e8ad4da2-2254-4788-874d-8bac62dda330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:56.469778 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e8ad4da2-2254-4788-874d-8bac62dda330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:56.640954 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-690bacb7-68f4-47bd-9639-eb11afc834b4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:56.641597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-690bacb7-68f4-47bd-9639-eb11afc834b4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:56.655680 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-690bacb7-68f4-47bd-9639-eb11afc834b4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:56.656176 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-690bacb7-68f4-47bd-9639-eb11afc834b4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:56.658617 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-690bacb7-68f4-47bd-9639-eb11afc834b4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:56.659321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-690bacb7-68f4-47bd-9639-eb11afc834b4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:56.680659 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e8ad4da2-2254-4788-874d-8bac62dda330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:56.688808 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e8ad4da2-2254-4788-874d-8bac62dda330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.232078 Aug 02 21:40:56.689649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 73/158] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:56 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:56.840338 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9484f8db-6278-4733-af91-7b6cff816fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:56.841543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9484f8db-6278-4733-af91-7b6cff816fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:56.849310 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9484f8db-6278-4733-af91-7b6cff816fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:56.850011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9484f8db-6278-4733-af91-7b6cff816fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:56.850800 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9484f8db-6278-4733-af91-7b6cff816fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:56.851230 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9484f8db-6278-4733-af91-7b6cff816fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:56.870753 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-690bacb7-68f4-47bd-9639-eb11afc834b4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:56.881498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-690bacb7-68f4-47bd-9639-eb11afc834b4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.245757 Aug 02 21:40:56.888535 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 86/159] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:56 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:57.012600 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9484f8db-6278-4733-af91-7b6cff816fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:57.020519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9484f8db-6278-4733-af91-7b6cff816fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.188360 Aug 02 21:40:57.021217 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 74/160] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:56 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:57.300909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:57.301623 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:57.308889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:57.309418 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:57.310543 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:57.311130 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:57.473101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:57.481622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:57.483127 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:57.484580 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f7d7a6d0-6a74-4632-a54d-ad2b94c157dc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.188800 Aug 02 21:40:57.485399 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 87/161] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:57 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:40:57.711949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0e98cd86-9dd4-43ba-9b61-71ffbbdbd63a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:57.713889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0e98cd86-9dd4-43ba-9b61-71ffbbdbd63a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:57.721364 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=91 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.723857 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e98cd86-9dd4-43ba-9b61-71ffbbdbd63a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:57.724522 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e98cd86-9dd4-43ba-9b61-71ffbbdbd63a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:57.725369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e98cd86-9dd4-43ba-9b61-71ffbbdbd63a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:57.725885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e98cd86-9dd4-43ba-9b61-71ffbbdbd63a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:57.878536 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0e98cd86-9dd4-43ba-9b61-71ffbbdbd63a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:57.888503 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0e98cd86-9dd4-43ba-9b61-71ffbbdbd63a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.182135 Aug 02 21:40:57.889076 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 75/162] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:57 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:57.905381 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4e327a45-610e-4570-b613-d387616f83c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:57.906641 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4e327a45-610e-4570-b613-d387616f83c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:57.912997 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e327a45-610e-4570-b613-d387616f83c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:57.913638 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e327a45-610e-4570-b613-d387616f83c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:57.914487 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e327a45-610e-4570-b613-d387616f83c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:57.915002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e327a45-610e-4570-b613-d387616f83c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:58.044065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0008f154-45ec-4eb5-93cd-0493144c97c9 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:58.045092 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0008f154-45ec-4eb5-93cd-0493144c97c9 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:58.054013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0008f154-45ec-4eb5-93cd-0493144c97c9 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:58.054827 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0008f154-45ec-4eb5-93cd-0493144c97c9 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:58.055950 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0008f154-45ec-4eb5-93cd-0493144c97c9 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:58.056910 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0008f154-45ec-4eb5-93cd-0493144c97c9 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:58.071208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4e327a45-610e-4570-b613-d387616f83c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:58.079941 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4e327a45-610e-4570-b613-d387616f83c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.180585 Aug 02 21:40:58.080761 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 88/163] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:57 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:58.234560 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0008f154-45ec-4eb5-93cd-0493144c97c9 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:58.243088 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0008f154-45ec-4eb5-93cd-0493144c97c9 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.205232 Aug 02 21:40:58.243692 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 76/164] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:58 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:58.507428 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:58.508038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:58.515084 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:58.515539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:58.516367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:58.516894 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:58.649058 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:58.657577 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:58.659084 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:58.660245 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-262c0d19-962e-49a8-a3e9-30a92acd28c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.157183 Aug 02 21:40:58.660805 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 89/165] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:58 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:40:58.911949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-81d6f078-6e5e-4b87-8d92-f07862611d5e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:58.912974 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-81d6f078-6e5e-4b87-8d92-f07862611d5e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:58.919717 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81d6f078-6e5e-4b87-8d92-f07862611d5e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:58.919892 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81d6f078-6e5e-4b87-8d92-f07862611d5e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:58.920723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81d6f078-6e5e-4b87-8d92-f07862611d5e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:58.921164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81d6f078-6e5e-4b87-8d92-f07862611d5e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:59.063480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-81d6f078-6e5e-4b87-8d92-f07862611d5e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:59.071612 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-81d6f078-6e5e-4b87-8d92-f07862611d5e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.164797 Aug 02 21:40:59.072199 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 77/166] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:58 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:59.102993 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-603e0ce9-0dbf-41de-80ea-a85b45346b1c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:59.103640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-603e0ce9-0dbf-41de-80ea-a85b45346b1c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:59.111341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-603e0ce9-0dbf-41de-80ea-a85b45346b1c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:59.111802 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-603e0ce9-0dbf-41de-80ea-a85b45346b1c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:59.112601 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-603e0ce9-0dbf-41de-80ea-a85b45346b1c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:59.113047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-603e0ce9-0dbf-41de-80ea-a85b45346b1c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:59.254887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-603e0ce9-0dbf-41de-80ea-a85b45346b1c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:59.263035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-603e0ce9-0dbf-41de-80ea-a85b45346b1c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.164062 Aug 02 21:40:59.263594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 90/167] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:59 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:40:59.263710 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0a54ba9c-28ff-488b-810b-0d4b8ab9bf05 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:59.264300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0a54ba9c-28ff-488b-810b-0d4b8ab9bf05 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:59.270281 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0a54ba9c-28ff-488b-810b-0d4b8ab9bf05 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:59.270738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0a54ba9c-28ff-488b-810b-0d4b8ab9bf05 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:59.271561 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0a54ba9c-28ff-488b-810b-0d4b8ab9bf05 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:59.272000 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0a54ba9c-28ff-488b-810b-0d4b8ab9bf05 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:59.407184 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0a54ba9c-28ff-488b-810b-0d4b8ab9bf05 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:59.415506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0a54ba9c-28ff-488b-810b-0d4b8ab9bf05 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.155976 Aug 02 21:40:59.416081 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 78/168] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:40:59 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:40:59.683151 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:40:59.683768 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:40:59.690290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:59.690761 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:59.691528 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:40:59.691988 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:40:59.821325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:59.829557 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:59.831077 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:40:59.832299 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2148b515-d02c-44bd-9188-a2ec1b2e65f0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.152999 Aug 02 21:40:59.832942 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 91/169] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:40:59 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:41:00.091412 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1dff8450-6873-4630-9fec-060631f3e50b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:00.092352 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1dff8450-6873-4630-9fec-060631f3e50b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:00.098245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1dff8450-6873-4630-9fec-060631f3e50b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:00.098695 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1dff8450-6873-4630-9fec-060631f3e50b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:00.099949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1dff8450-6873-4630-9fec-060631f3e50b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:00.100400 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1dff8450-6873-4630-9fec-060631f3e50b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:00.230933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1dff8450-6873-4630-9fec-060631f3e50b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:00.238337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1dff8450-6873-4630-9fec-060631f3e50b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.150789 Aug 02 21:41:00.238901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 79/170] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:00 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:00.283179 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4cc42490-dfc7-4a68-82a6-8bb99bad7eda tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:00.283869 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4cc42490-dfc7-4a68-82a6-8bb99bad7eda tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:00.290140 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4cc42490-dfc7-4a68-82a6-8bb99bad7eda tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:00.290597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4cc42490-dfc7-4a68-82a6-8bb99bad7eda tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:00.291361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4cc42490-dfc7-4a68-82a6-8bb99bad7eda tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:00.291798 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4cc42490-dfc7-4a68-82a6-8bb99bad7eda tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:00.418638 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4cc42490-dfc7-4a68-82a6-8bb99bad7eda tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:00.425910 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4cc42490-dfc7-4a68-82a6-8bb99bad7eda tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.146587 Aug 02 21:41:00.426459 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 92/171] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:00 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:00.437122 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a7ae6f4f-691c-45af-a9b0-c52b4cdc3d0b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:00.437738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a7ae6f4f-691c-45af-a9b0-c52b4cdc3d0b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:00.444203 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a7ae6f4f-691c-45af-a9b0-c52b4cdc3d0b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:00.444656 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a7ae6f4f-691c-45af-a9b0-c52b4cdc3d0b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:00.445422 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a7ae6f4f-691c-45af-a9b0-c52b4cdc3d0b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:00.445859 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a7ae6f4f-691c-45af-a9b0-c52b4cdc3d0b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:00.573701 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a7ae6f4f-691c-45af-a9b0-c52b4cdc3d0b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:00.581460 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a7ae6f4f-691c-45af-a9b0-c52b4cdc3d0b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.147985 Aug 02 21:41:00.582262 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 80/172] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:00 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:00.855590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:00.856236 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:00.862225 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:00.862707 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:00.863503 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:00.863943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:00.997454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:01.005709 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:01.007256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:01.008401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c3f53d73-1e00-4f1c-a117-0ec523d0aacc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.156901 Aug 02 21:41:01.009026 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 93/173] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:41:00 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:41:01.259012 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7404d456-2f3c-4edc-adbf-a2a5dcde8b53 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:01.259719 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7404d456-2f3c-4edc-adbf-a2a5dcde8b53 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:01.265916 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7404d456-2f3c-4edc-adbf-a2a5dcde8b53 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:01.266473 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7404d456-2f3c-4edc-adbf-a2a5dcde8b53 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:01.267337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7404d456-2f3c-4edc-adbf-a2a5dcde8b53 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:01.267892 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7404d456-2f3c-4edc-adbf-a2a5dcde8b53 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:01.394121 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7404d456-2f3c-4edc-adbf-a2a5dcde8b53 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:01.402780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7404d456-2f3c-4edc-adbf-a2a5dcde8b53 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.147677 Aug 02 21:41:01.403352 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 81/174] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:01 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:01.446700 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2d7970fb-8a53-4096-8cb8-2655f062efa2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:01.447471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2d7970fb-8a53-4096-8cb8-2655f062efa2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:01.453795 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2d7970fb-8a53-4096-8cb8-2655f062efa2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:01.454249 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2d7970fb-8a53-4096-8cb8-2655f062efa2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:01.455019 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2d7970fb-8a53-4096-8cb8-2655f062efa2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:01.455462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2d7970fb-8a53-4096-8cb8-2655f062efa2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:01.584300 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2d7970fb-8a53-4096-8cb8-2655f062efa2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:01.591810 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2d7970fb-8a53-4096-8cb8-2655f062efa2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.148968 Aug 02 21:41:01.592401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 94/175] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:01 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:01.602723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4295ec93-09fb-4ea5-8549-677d50c4089b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:01.603489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4295ec93-09fb-4ea5-8549-677d50c4089b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:01.609591 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4295ec93-09fb-4ea5-8549-677d50c4089b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:01.610045 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4295ec93-09fb-4ea5-8549-677d50c4089b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:01.610814 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4295ec93-09fb-4ea5-8549-677d50c4089b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:01.611258 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4295ec93-09fb-4ea5-8549-677d50c4089b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:01.741036 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4295ec93-09fb-4ea5-8549-677d50c4089b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:01.748429 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4295ec93-09fb-4ea5-8549-677d50c4089b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.149584 Aug 02 21:41:01.748974 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 82/176] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:01 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:02.031053 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:02.031840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:02.041059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.041511 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.042463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.042899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.187402 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:02.195721 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:02.197266 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:02.198383 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5af572b0-293c-4916-9e48-272621899f7c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.171623 Aug 02 21:41:02.198954 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 95/177] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:41:02 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:41:02.422895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-132d0a8d-0554-4d96-b002-f41ffed8a588 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:02.423512 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-132d0a8d-0554-4d96-b002-f41ffed8a588 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:02.429574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-132d0a8d-0554-4d96-b002-f41ffed8a588 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.430025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-132d0a8d-0554-4d96-b002-f41ffed8a588 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.430787 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-132d0a8d-0554-4d96-b002-f41ffed8a588 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.431220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-132d0a8d-0554-4d96-b002-f41ffed8a588 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.469470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-397677bb-7211-49a1-82f3-e04fa930c387 req-45594ed0-e5e5-4bad-bf32-b87429adc380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29658748-1966-42f3-9fec-c72df8ee883d", "name": "network-vif-plugged", "status": "completed", "tag": "9519b829-ec58-4b2f-a032-377ada1ca4aa"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:02.485538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-397677bb-7211-49a1-82f3-e04fa930c387 req-45594ed0-e5e5-4bad-bf32-b87429adc380 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.486377 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-397677bb-7211-49a1-82f3-e04fa930c387 req-45594ed0-e5e5-4bad-bf32-b87429adc380 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.499510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-397677bb-7211-49a1-82f3-e04fa930c387 req-45594ed0-e5e5-4bad-bf32-b87429adc380 service nova] Creating event network-vif-plugged:9519b829-ec58-4b2f-a032-377ada1ca4aa for instance 29658748-1966-42f3-9fec-c72df8ee883d on hv-cinder-85144 Aug 02 21:41:02.507398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-397677bb-7211-49a1-82f3-e04fa930c387 req-45594ed0-e5e5-4bad-bf32-b87429adc380 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043549 Aug 02 21:41:02.508538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 96/178] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:41:02.580688 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-132d0a8d-0554-4d96-b002-f41ffed8a588 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:02.591401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-132d0a8d-0554-4d96-b002-f41ffed8a588 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.172358 Aug 02 21:41:02.592005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 83/179] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:02 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:02.613982 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-83bd070a-f90c-499d-bd23-40688b41ffca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:02.615712 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-83bd070a-f90c-499d-bd23-40688b41ffca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:02.621951 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83bd070a-f90c-499d-bd23-40688b41ffca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.622408 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83bd070a-f90c-499d-bd23-40688b41ffca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.623180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83bd070a-f90c-499d-bd23-40688b41ffca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.623620 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83bd070a-f90c-499d-bd23-40688b41ffca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.627634 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:02.761586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-83bd070a-f90c-499d-bd23-40688b41ffca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:02.769360 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-83bd070a-f90c-499d-bd23-40688b41ffca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.160643 Aug 02 21:41:02.769512 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5b226afe-5842-478e-922f-870b8c1e0bd1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:02.769922 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 97/180] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:02 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:02.770066 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5b226afe-5842-478e-922f-870b8c1e0bd1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:02.776967 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5b226afe-5842-478e-922f-870b8c1e0bd1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.777430 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5b226afe-5842-478e-922f-870b8c1e0bd1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.778296 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5b226afe-5842-478e-922f-870b8c1e0bd1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:02.778737 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5b226afe-5842-478e-922f-870b8c1e0bd1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:02.909996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5b226afe-5842-478e-922f-870b8c1e0bd1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:02.919022 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5b226afe-5842-478e-922f-870b8c1e0bd1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.153476 Aug 02 21:41:02.919650 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 84/181] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:02 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:41:03.223392 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:03.224338 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:03.233821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:03.234454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:03.235368 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:03.235858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:03.587185 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:03.601478 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:03.603255 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:03.604401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-570a17a8-1e74-4897-abd3-468e53cf0c9f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.385399 Aug 02 21:41:03.604951 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 98/182] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:41:03 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:41:03.615227 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-364c71f6-257f-44de-88e0-8a142f15b8d8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:03.616369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-364c71f6-257f-44de-88e0-8a142f15b8d8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:03.627302 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-364c71f6-257f-44de-88e0-8a142f15b8d8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:03.628763 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-364c71f6-257f-44de-88e0-8a142f15b8d8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:03.629748 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-364c71f6-257f-44de-88e0-8a142f15b8d8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:03.630233 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-364c71f6-257f-44de-88e0-8a142f15b8d8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:03.792608 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-364c71f6-257f-44de-88e0-8a142f15b8d8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:03.792935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-08530bb6-6631-428d-b265-1810bfc14841 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:03.793808 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-08530bb6-6631-428d-b265-1810bfc14841 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:03.801112 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-08530bb6-6631-428d-b265-1810bfc14841 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:03.802247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-08530bb6-6631-428d-b265-1810bfc14841 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:03.803178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-08530bb6-6631-428d-b265-1810bfc14841 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:03.804367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-08530bb6-6631-428d-b265-1810bfc14841 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:03.811209 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-364c71f6-257f-44de-88e0-8a142f15b8d8 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.201322 Aug 02 21:41:03.812372 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 85/183] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:03 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:03.941346 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-dfa44cc3-923b-4eb0-a793-60dd40c7e8c1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:03.942195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-dfa44cc3-923b-4eb0-a793-60dd40c7e8c1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:03.949065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dfa44cc3-923b-4eb0-a793-60dd40c7e8c1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:03.949753 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dfa44cc3-923b-4eb0-a793-60dd40c7e8c1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:03.950789 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dfa44cc3-923b-4eb0-a793-60dd40c7e8c1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:03.951380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dfa44cc3-923b-4eb0-a793-60dd40c7e8c1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:03.958747 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-08530bb6-6631-428d-b265-1810bfc14841 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:03.971961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-08530bb6-6631-428d-b265-1810bfc14841 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.182275 Aug 02 21:41:03.972738 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 99/184] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:03 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:41:04.163259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-dfa44cc3-923b-4eb0-a793-60dd40c7e8c1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:04.171578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-dfa44cc3-923b-4eb0-a793-60dd40c7e8c1 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.234804 Aug 02 21:41:04.172176 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 86/185] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:03 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:41:04.634926 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:04.635857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:04.642137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:04.642669 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:04.643563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:04.644265 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:04.836918 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c10cf5d5-32b9-40b3-9f5d-6cfb6b830610 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:04.837549 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c10cf5d5-32b9-40b3-9f5d-6cfb6b830610 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:04.846936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c10cf5d5-32b9-40b3-9f5d-6cfb6b830610 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:04.847406 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c10cf5d5-32b9-40b3-9f5d-6cfb6b830610 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:04.851271 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c10cf5d5-32b9-40b3-9f5d-6cfb6b830610 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:04.851740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c10cf5d5-32b9-40b3-9f5d-6cfb6b830610 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:04.856226 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:04.867395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:04.869564 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:04.870889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-01690ef1-76af-4ec9-ba67-112ee5415fe1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.239904 Aug 02 21:41:04.871710 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 100/186] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:41:04 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:41:04.994569 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0b323333-a7b3-40dc-87a1-765a59504dc3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:04.995320 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0b323333-a7b3-40dc-87a1-765a59504dc3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:05.002935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b323333-a7b3-40dc-87a1-765a59504dc3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:05.003692 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b323333-a7b3-40dc-87a1-765a59504dc3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:05.004771 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b323333-a7b3-40dc-87a1-765a59504dc3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:05.005431 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b323333-a7b3-40dc-87a1-765a59504dc3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:05.237636 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0b323333-a7b3-40dc-87a1-765a59504dc3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:05.254771 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0b323333-a7b3-40dc-87a1-765a59504dc3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.264649 Aug 02 21:41:05.269435 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 101/187] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:04 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:41:05.280421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2ae64ca2-866b-46f0-9f12-f58fcb7640f3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:05.281047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2ae64ca2-866b-46f0-9f12-f58fcb7640f3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:05.295882 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2ae64ca2-866b-46f0-9f12-f58fcb7640f3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:05.296439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2ae64ca2-866b-46f0-9f12-f58fcb7640f3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:05.297298 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2ae64ca2-866b-46f0-9f12-f58fcb7640f3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:05.297805 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2ae64ca2-866b-46f0-9f12-f58fcb7640f3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:05.298335 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c10cf5d5-32b9-40b3-9f5d-6cfb6b830610 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:05.309105 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c10cf5d5-32b9-40b3-9f5d-6cfb6b830610 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.479867 Aug 02 21:41:05.322667 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 87/188] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:04 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:05.436065 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2ae64ca2-866b-46f0-9f12-f58fcb7640f3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:05.444013 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2ae64ca2-866b-46f0-9f12-f58fcb7640f3 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.173448 Aug 02 21:41:05.444699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 102/189] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:05 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:05.894550 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:05.895243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:05.902494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:05.903015 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:05.903972 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:05.904493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:05.926300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=100 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:06.065553 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:06.074320 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:06.084800 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:06.086165 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-aa0de5c9-ca02-47c5-9a5b-5b6b314bda0a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.196539 Aug 02 21:41:06.086772 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 88/190] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:41:05 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:41:06.280578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-06c5bb18-530c-4d09-b334-74d967a6cbfd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:06.281196 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-06c5bb18-530c-4d09-b334-74d967a6cbfd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:06.287258 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-06c5bb18-530c-4d09-b334-74d967a6cbfd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:06.287906 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-06c5bb18-530c-4d09-b334-74d967a6cbfd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:06.288869 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-06c5bb18-530c-4d09-b334-74d967a6cbfd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:06.289315 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-06c5bb18-530c-4d09-b334-74d967a6cbfd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:06.336781 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f6ae7745-d331-40fc-9e0c-e196094e65c1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:06.337920 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f6ae7745-d331-40fc-9e0c-e196094e65c1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:06.347809 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f6ae7745-d331-40fc-9e0c-e196094e65c1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:06.348803 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f6ae7745-d331-40fc-9e0c-e196094e65c1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:06.351155 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f6ae7745-d331-40fc-9e0c-e196094e65c1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:06.352219 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f6ae7745-d331-40fc-9e0c-e196094e65c1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:06.462565 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-06c5bb18-530c-4d09-b334-74d967a6cbfd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:06.473965 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-06c5bb18-530c-4d09-b334-74d967a6cbfd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.197151 Aug 02 21:41:06.474602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 103/191] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:06 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:06.481203 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e621c228-5c82-4ffa-b909-7015b0aa2fe2 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:06.482128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e621c228-5c82-4ffa-b909-7015b0aa2fe2 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:06.488629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:06.491045 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e621c228-5c82-4ffa-b909-7015b0aa2fe2 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:06.491498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e621c228-5c82-4ffa-b909-7015b0aa2fe2 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:06.492301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e621c228-5c82-4ffa-b909-7015b0aa2fe2 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:06.493276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e621c228-5c82-4ffa-b909-7015b0aa2fe2 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:06.593901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f6ae7745-d331-40fc-9e0c-e196094e65c1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:06.611956 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f6ae7745-d331-40fc-9e0c-e196094e65c1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.280480 Aug 02 21:41:06.613119 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 89/192] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:06 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:41:06.623996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-8f6e11a0-bb18-416c-9472-71f66ed7b458 req-6145eb26-36bf-47f1-b5eb-24700a3c8be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffdc7be9-6b66-4157-8533-c7fedcee85cd", "name": "network-vif-plugged", "status": "completed", "tag": "e78e48c5-9b03-4f00-86f4-4b6796ab3b28"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:06.641139 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-8f6e11a0-bb18-416c-9472-71f66ed7b458 req-6145eb26-36bf-47f1-b5eb-24700a3c8be8 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:06.641583 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-8f6e11a0-bb18-416c-9472-71f66ed7b458 req-6145eb26-36bf-47f1-b5eb-24700a3c8be8 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:06.663574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-8f6e11a0-bb18-416c-9472-71f66ed7b458 req-6145eb26-36bf-47f1-b5eb-24700a3c8be8 service nova] Creating event network-vif-plugged:e78e48c5-9b03-4f00-86f4-4b6796ab3b28 for instance ffdc7be9-6b66-4157-8533-c7fedcee85cd on hv-cinder-85144 Aug 02 21:41:06.681754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-8f6e11a0-bb18-416c-9472-71f66ed7b458 req-6145eb26-36bf-47f1-b5eb-24700a3c8be8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067929 Aug 02 21:41:06.682356 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 90/193] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:41:06.713364 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e621c228-5c82-4ffa-b909-7015b0aa2fe2 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:06.732039 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e621c228-5c82-4ffa-b909-7015b0aa2fe2 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1313 microversion: 2.1 time: 0.255931 Aug 02 21:41:06.732654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 104/194] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:06 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:07.110035 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:07.110725 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:07.124791 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:07.125894 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:07.127654 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:07.128392 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:07.310464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:07.319648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:07.321316 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:07.322470 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bee39044-0c10-4090-8140-36682768ea1b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1405 microversion: 2.20 time: 0.216747 Aug 02 21:41:07.323033 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 91/195] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:41:07 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:41:07.494794 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c134eaae-bada-418c-ba9a-551922e000d8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:07.495414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c134eaae-bada-418c-ba9a-551922e000d8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:07.501507 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c134eaae-bada-418c-ba9a-551922e000d8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:07.501966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c134eaae-bada-418c-ba9a-551922e000d8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:07.502751 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c134eaae-bada-418c-ba9a-551922e000d8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:07.503193 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c134eaae-bada-418c-ba9a-551922e000d8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:07.638975 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-df30b7e6-af7d-4465-8f71-be84fa9166ef tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:07.639776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-df30b7e6-af7d-4465-8f71-be84fa9166ef tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:07.646541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-df30b7e6-af7d-4465-8f71-be84fa9166ef tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:07.647175 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-df30b7e6-af7d-4465-8f71-be84fa9166ef tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:07.648087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-df30b7e6-af7d-4465-8f71-be84fa9166ef tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:07.648685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-df30b7e6-af7d-4465-8f71-be84fa9166ef tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:07.670816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c134eaae-bada-418c-ba9a-551922e000d8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:07.682152 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c134eaae-bada-418c-ba9a-551922e000d8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.191105 Aug 02 21:41:07.683302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 105/196] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:07 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:07.754147 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6b28e6e4-ed2b-4488-b80f-2062b6310869 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:07.754793 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6b28e6e4-ed2b-4488-b80f-2062b6310869 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:07.761724 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b28e6e4-ed2b-4488-b80f-2062b6310869 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:07.762173 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b28e6e4-ed2b-4488-b80f-2062b6310869 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:07.762940 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b28e6e4-ed2b-4488-b80f-2062b6310869 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:07.763538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b28e6e4-ed2b-4488-b80f-2062b6310869 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:07.798424 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-df30b7e6-af7d-4465-8f71-be84fa9166ef tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:07.807394 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-df30b7e6-af7d-4465-8f71-be84fa9166ef tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.172204 Aug 02 21:41:07.815568 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 92/197] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:07 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:41:07.938800 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6b28e6e4-ed2b-4488-b80f-2062b6310869 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:07.946526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6b28e6e4-ed2b-4488-b80f-2062b6310869 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1499 microversion: 2.1 time: 0.196118 Aug 02 21:41:07.960507 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 106/198] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:07 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1499 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:41:08.358228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:08.358836 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:08.366251 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:08.370584 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:08.371436 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:08.371834 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:08.577455 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:08.595740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:08.597385 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:08.598733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-abc55c94-89c6-4616-a352-e3ab539ab03c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1597 microversion: 2.20 time: 0.251657 Aug 02 21:41:08.599292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 93/199] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:41:08 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1597 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:41:08.622962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7b404c52-8d75-451b-bf5e-beb7878c76d4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:08.624023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7b404c52-8d75-451b-bf5e-beb7878c76d4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:08.632467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7b404c52-8d75-451b-bf5e-beb7878c76d4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:08.634183 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7b404c52-8d75-451b-bf5e-beb7878c76d4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:08.635132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7b404c52-8d75-451b-bf5e-beb7878c76d4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:08.635575 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7b404c52-8d75-451b-bf5e-beb7878c76d4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:08.705787 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f310bf27-512d-4713-b22f-47356dc593f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:08.706499 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f310bf27-512d-4713-b22f-47356dc593f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:08.714603 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f310bf27-512d-4713-b22f-47356dc593f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:08.715339 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f310bf27-512d-4713-b22f-47356dc593f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:08.717500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f310bf27-512d-4713-b22f-47356dc593f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:08.718719 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f310bf27-512d-4713-b22f-47356dc593f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:08.848520 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7b404c52-8d75-451b-bf5e-beb7878c76d4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.229889 Aug 02 21:41:08.849353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 107/200] 10.222.0.57 () {60 vars in 1316 bytes} [Tue Aug 2 21:41:08 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:41:08.856889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5e5e13ea-d4cb-4a7e-bd16-f60755017e0b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:08.858155 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5e5e13ea-d4cb-4a7e-bd16-f60755017e0b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:08.865945 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5e5e13ea-d4cb-4a7e-bd16-f60755017e0b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:08.868022 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5e5e13ea-d4cb-4a7e-bd16-f60755017e0b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:08.868871 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5e5e13ea-d4cb-4a7e-bd16-f60755017e0b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:08.869318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5e5e13ea-d4cb-4a7e-bd16-f60755017e0b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:08.983618 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f310bf27-512d-4713-b22f-47356dc593f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:08.992839 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f310bf27-512d-4713-b22f-47356dc593f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.292911 Aug 02 21:41:08.993923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 94/201] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:08 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:41:09.286700 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5e5e13ea-d4cb-4a7e-bd16-f60755017e0b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:09.297430 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5e5e13ea-d4cb-4a7e-bd16-f60755017e0b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1363 microversion: 2.1 time: 0.446638 Aug 02 21:41:09.298431 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 108/202] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:08 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:09.459903 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6c012781-113f-4deb-a5ac-44c62728ad5b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32cb5b6a-4dab-434c-9384-f6798e493f92"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:09.464228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6c012781-113f-4deb-a5ac-44c62728ad5b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:09.480640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6c012781-113f-4deb-a5ac-44c62728ad5b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:09.481518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6c012781-113f-4deb-a5ac-44c62728ad5b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:09.482991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6c012781-113f-4deb-a5ac-44c62728ad5b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:09.484792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6c012781-113f-4deb-a5ac-44c62728ad5b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:10.015844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0042ab9e-371d-42fe-8282-43d24fc2256a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:10.017013 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0042ab9e-371d-42fe-8282-43d24fc2256a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:10.028214 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0042ab9e-371d-42fe-8282-43d24fc2256a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:10.028707 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0042ab9e-371d-42fe-8282-43d24fc2256a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:10.029490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0042ab9e-371d-42fe-8282-43d24fc2256a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:10.030031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0042ab9e-371d-42fe-8282-43d24fc2256a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:10.469060 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0042ab9e-371d-42fe-8282-43d24fc2256a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:10.495428 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0042ab9e-371d-42fe-8282-43d24fc2256a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1365 microversion: 2.1 time: 0.483581 Aug 02 21:41:10.496859 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 109/203] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:10 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1365 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:10.502847 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-65f12360-8c98-47d4-af61-b76bb8c79731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:10.503819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-65f12360-8c98-47d4-af61-b76bb8c79731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:10.512384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-65f12360-8c98-47d4-af61-b76bb8c79731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:10.513340 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-65f12360-8c98-47d4-af61-b76bb8c79731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:10.514329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-65f12360-8c98-47d4-af61-b76bb8c79731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:10.515031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-65f12360-8c98-47d4-af61-b76bb8c79731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:10.897555 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-65f12360-8c98-47d4-af61-b76bb8c79731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:10.910801 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-65f12360-8c98-47d4-af61-b76bb8c79731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1549 microversion: 2.1 time: 0.410353 Aug 02 21:41:10.914113 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 110/204] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:10 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1549 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:10.934143 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-81e6b4a2-c141-4a48-acc8-4d9f18b1fb72 req-b40ce933-7770-4b53-a057-9d69221e6771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "581dd5c7-3160-47ed-ac20-6d35cbd6604c", "tag": "1b078072-8634-47d5-b163-fe8eb6da769b"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:10.950989 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-81e6b4a2-c141-4a48-acc8-4d9f18b1fb72 req-b40ce933-7770-4b53-a057-9d69221e6771 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:10.951436 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-81e6b4a2-c141-4a48-acc8-4d9f18b1fb72 req-b40ce933-7770-4b53-a057-9d69221e6771 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:10.988588 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-81e6b4a2-c141-4a48-acc8-4d9f18b1fb72 req-b40ce933-7770-4b53-a057-9d69221e6771 service nova] Creating event network-changed:1b078072-8634-47d5-b163-fe8eb6da769b for instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c on hv-cinder-85144 Aug 02 21:41:10.996469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-81e6b4a2-c141-4a48-acc8-4d9f18b1fb72 req-b40ce933-7770-4b53-a057-9d69221e6771 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066807 Aug 02 21:41:10.997639 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 111/205] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:41:11.005276 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6c012781-113f-4deb-a5ac-44c62728ad5b tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "POST /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.552914 Aug 02 21:41:11.008193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 95/206] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:41:09 2022] POST /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e/os-volume_attachments => generated 194 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:41:11.017193 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e1720736-8f1e-4f53-a488-14e8e42a6531 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:11.021512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e1720736-8f1e-4f53-a488-14e8e42a6531 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:11.032979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e1720736-8f1e-4f53-a488-14e8e42a6531 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:11.033432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e1720736-8f1e-4f53-a488-14e8e42a6531 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:11.038033 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e1720736-8f1e-4f53-a488-14e8e42a6531 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:11.038492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e1720736-8f1e-4f53-a488-14e8e42a6531 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:11.181899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e1720736-8f1e-4f53-a488-14e8e42a6531 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.182669 Aug 02 21:41:11.182481 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 112/207] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 2 21:41:10 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:41:11.532003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d0b9d789-3334-4da9-8c4f-724b1f7baee7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:11.536343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d0b9d789-3334-4da9-8c4f-724b1f7baee7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:11.556225 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d0b9d789-3334-4da9-8c4f-724b1f7baee7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:11.557879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d0b9d789-3334-4da9-8c4f-724b1f7baee7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:11.560825 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d0b9d789-3334-4da9-8c4f-724b1f7baee7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:11.561517 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d0b9d789-3334-4da9-8c4f-724b1f7baee7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:11.877398 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d0b9d789-3334-4da9-8c4f-724b1f7baee7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:11.889013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d0b9d789-3334-4da9-8c4f-724b1f7baee7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1555 microversion: 2.1 time: 0.370799 Aug 02 21:41:11.889779 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 96/208] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:11 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1555 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:11.911988 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-75a60fd0-d75f-4e62-ba4c-3ae81a750b5a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:11.912631 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-75a60fd0-d75f-4e62-ba4c-3ae81a750b5a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:11.919328 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-75a60fd0-d75f-4e62-ba4c-3ae81a750b5a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:11.919989 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-75a60fd0-d75f-4e62-ba4c-3ae81a750b5a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:11.921078 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-75a60fd0-d75f-4e62-ba4c-3ae81a750b5a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:11.922301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-75a60fd0-d75f-4e62-ba4c-3ae81a750b5a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:12.222328 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-75a60fd0-d75f-4e62-ba4c-3ae81a750b5a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.310404 Aug 02 21:41:12.224406 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 113/209] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 2 21:41:11 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-interface => generated 284 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:41:13.025605 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-e158eac5-cc7e-4f6e-a5f8-d85503312691 req-28109b4d-1e31-4c77-bfa1-6fdad17bcc2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29658748-1966-42f3-9fec-c72df8ee883d", "tag": "9519b829-ec58-4b2f-a032-377ada1ca4aa"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:13.036565 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-e158eac5-cc7e-4f6e-a5f8-d85503312691 req-28109b4d-1e31-4c77-bfa1-6fdad17bcc2f service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:13.037247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-e158eac5-cc7e-4f6e-a5f8-d85503312691 req-28109b4d-1e31-4c77-bfa1-6fdad17bcc2f service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:13.050079 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-e158eac5-cc7e-4f6e-a5f8-d85503312691 req-28109b4d-1e31-4c77-bfa1-6fdad17bcc2f service nova] Creating event network-changed:9519b829-ec58-4b2f-a032-377ada1ca4aa for instance 29658748-1966-42f3-9fec-c72df8ee883d on hv-cinder-85144 Aug 02 21:41:13.055815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-e158eac5-cc7e-4f6e-a5f8-d85503312691 req-28109b4d-1e31-4c77-bfa1-6fdad17bcc2f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034456 Aug 02 21:41:13.056833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 97/210] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:41:14.152530 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-bf121ae1-818e-4917-8531-246b79e1de06 req-8a35ef75-2c32-433b-9d18-b3f90bf68099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffdc7be9-6b66-4157-8533-c7fedcee85cd", "tag": "e78e48c5-9b03-4f00-86f4-4b6796ab3b28"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:14.204679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-bf121ae1-818e-4917-8531-246b79e1de06 req-8a35ef75-2c32-433b-9d18-b3f90bf68099 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:14.204679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-bf121ae1-818e-4917-8531-246b79e1de06 req-8a35ef75-2c32-433b-9d18-b3f90bf68099 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:14.240208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-bf121ae1-818e-4917-8531-246b79e1de06 req-8a35ef75-2c32-433b-9d18-b3f90bf68099 service nova] Creating event network-changed:e78e48c5-9b03-4f00-86f4-4b6796ab3b28 for instance ffdc7be9-6b66-4157-8533-c7fedcee85cd on hv-cinder-85144 Aug 02 21:41:14.245535 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-bf121ae1-818e-4917-8531-246b79e1de06 req-8a35ef75-2c32-433b-9d18-b3f90bf68099 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097534 Aug 02 21:41:14.246471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 114/211] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:41:22.215950 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bc7d5a75-982d-4a3a-95aa-b2179b05081a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:22.216570 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bc7d5a75-982d-4a3a-95aa-b2179b05081a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:22.222910 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bc7d5a75-982d-4a3a-95aa-b2179b05081a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:22.223388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bc7d5a75-982d-4a3a-95aa-b2179b05081a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:22.224029 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bc7d5a75-982d-4a3a-95aa-b2179b05081a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:22.224507 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bc7d5a75-982d-4a3a-95aa-b2179b05081a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:22.249996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bc7d5a75-982d-4a3a-95aa-b2179b05081a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:41:22.345243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bc7d5a75-982d-4a3a-95aa-b2179b05081a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 204 len: 0 microversion: 2.1 time: 0.133782 Aug 02 21:41:22.346362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 98/212] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:41:22 2022] DELETE /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:41:22.357837 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4406ca5b-5b50-4ca1-9655-5858d4711a98 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:22.358756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4406ca5b-5b50-4ca1-9655-5858d4711a98 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:22.365671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4406ca5b-5b50-4ca1-9655-5858d4711a98 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:22.366204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4406ca5b-5b50-4ca1-9655-5858d4711a98 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:22.367085 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4406ca5b-5b50-4ca1-9655-5858d4711a98 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:22.367629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4406ca5b-5b50-4ca1-9655-5858d4711a98 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:22.507178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4406ca5b-5b50-4ca1-9655-5858d4711a98 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:22.515112 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4406ca5b-5b50-4ca1-9655-5858d4711a98 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.163053 Aug 02 21:41:22.515671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 115/213] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:22 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:23.541049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d451e7c8-471a-4aa3-9152-0b304dbc21d5 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:23.541049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d451e7c8-471a-4aa3-9152-0b304dbc21d5 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:23.544928 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d451e7c8-471a-4aa3-9152-0b304dbc21d5 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:23.545383 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d451e7c8-471a-4aa3-9152-0b304dbc21d5 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:23.546154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d451e7c8-471a-4aa3-9152-0b304dbc21d5 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:23.546623 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d451e7c8-471a-4aa3-9152-0b304dbc21d5 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:23.688075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d451e7c8-471a-4aa3-9152-0b304dbc21d5 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:23.696833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d451e7c8-471a-4aa3-9152-0b304dbc21d5 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.164655 Aug 02 21:41:23.697394 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 99/214] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:23 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:24.717512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-29e2368c-cfe7-4a55-bc76-11a30acdee13 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:24.718135 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-29e2368c-cfe7-4a55-bc76-11a30acdee13 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:24.724865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-29e2368c-cfe7-4a55-bc76-11a30acdee13 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:24.725353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-29e2368c-cfe7-4a55-bc76-11a30acdee13 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:24.726152 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-29e2368c-cfe7-4a55-bc76-11a30acdee13 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:24.726602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-29e2368c-cfe7-4a55-bc76-11a30acdee13 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:24.730954 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:24.858899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-29e2368c-cfe7-4a55-bc76-11a30acdee13 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:24.867397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-29e2368c-cfe7-4a55-bc76-11a30acdee13 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.153659 Aug 02 21:41:24.867972 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 116/215] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:24 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:25.888327 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-575098b1-49f2-43da-96a5-c9124c6a3385 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:25.888974 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-575098b1-49f2-43da-96a5-c9124c6a3385 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:25.895989 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-575098b1-49f2-43da-96a5-c9124c6a3385 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:25.896467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-575098b1-49f2-43da-96a5-c9124c6a3385 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:25.897229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-575098b1-49f2-43da-96a5-c9124c6a3385 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:25.897665 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-575098b1-49f2-43da-96a5-c9124c6a3385 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:26.029782 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-575098b1-49f2-43da-96a5-c9124c6a3385 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:26.038894 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-575098b1-49f2-43da-96a5-c9124c6a3385 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.154425 Aug 02 21:41:26.039500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 100/216] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:25 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:27.059525 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-346df4aa-ce73-40f2-9a7d-279eee014f34 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:27.060193 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-346df4aa-ce73-40f2-9a7d-279eee014f34 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:27.066139 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-346df4aa-ce73-40f2-9a7d-279eee014f34 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:27.066597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-346df4aa-ce73-40f2-9a7d-279eee014f34 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:27.067364 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-346df4aa-ce73-40f2-9a7d-279eee014f34 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:27.067804 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-346df4aa-ce73-40f2-9a7d-279eee014f34 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:27.196926 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-346df4aa-ce73-40f2-9a7d-279eee014f34 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:27.204981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-346df4aa-ce73-40f2-9a7d-279eee014f34 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.149262 Aug 02 21:41:27.205718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 117/217] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:27 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:28.228929 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ef2b20b3-8c39-4163-98fd-8699eaefacf4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:28.230174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ef2b20b3-8c39-4163-98fd-8699eaefacf4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:28.232580 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:28.237726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef2b20b3-8c39-4163-98fd-8699eaefacf4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:28.238167 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef2b20b3-8c39-4163-98fd-8699eaefacf4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:28.238922 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef2b20b3-8c39-4163-98fd-8699eaefacf4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:28.239350 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef2b20b3-8c39-4163-98fd-8699eaefacf4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:28.379658 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ef2b20b3-8c39-4163-98fd-8699eaefacf4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:28.388634 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ef2b20b3-8c39-4163-98fd-8699eaefacf4 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.163645 Aug 02 21:41:28.389284 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 101/218] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:28 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:29.411269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8e380c82-3de5-4789-8492-fc83f7030dcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:29.411879 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8e380c82-3de5-4789-8492-fc83f7030dcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:29.417880 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8e380c82-3de5-4789-8492-fc83f7030dcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:29.418336 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8e380c82-3de5-4789-8492-fc83f7030dcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:29.419105 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8e380c82-3de5-4789-8492-fc83f7030dcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:29.419542 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8e380c82-3de5-4789-8492-fc83f7030dcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:29.550156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8e380c82-3de5-4789-8492-fc83f7030dcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:29.559478 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8e380c82-3de5-4789-8492-fc83f7030dcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.152202 Aug 02 21:41:29.560050 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 118/219] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:29 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:30.581023 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7430c1b3-e055-497c-8375-12332dfee399 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:30.581663 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7430c1b3-e055-497c-8375-12332dfee399 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:30.588358 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7430c1b3-e055-497c-8375-12332dfee399 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:30.588807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7430c1b3-e055-497c-8375-12332dfee399 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:30.589571 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7430c1b3-e055-497c-8375-12332dfee399 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:30.590008 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7430c1b3-e055-497c-8375-12332dfee399 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:30.715643 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7430c1b3-e055-497c-8375-12332dfee399 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:30.724050 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7430c1b3-e055-497c-8375-12332dfee399 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.146931 Aug 02 21:41:30.724648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 102/220] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:30 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:31.745376 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ad9e7d96-815e-4271-b8aa-4ae63644c4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:31.745915 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ad9e7d96-815e-4271-b8aa-4ae63644c4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:31.751982 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad9e7d96-815e-4271-b8aa-4ae63644c4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:31.752473 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad9e7d96-815e-4271-b8aa-4ae63644c4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:31.753238 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad9e7d96-815e-4271-b8aa-4ae63644c4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:31.753674 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad9e7d96-815e-4271-b8aa-4ae63644c4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:31.892197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ad9e7d96-815e-4271-b8aa-4ae63644c4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:31.900773 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ad9e7d96-815e-4271-b8aa-4ae63644c4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.159249 Aug 02 21:41:31.901601 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 119/221] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:31 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:32.922197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-22f53530-144b-44aa-b51d-a2b14a623332 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:32.922860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-22f53530-144b-44aa-b51d-a2b14a623332 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:32.930629 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-22f53530-144b-44aa-b51d-a2b14a623332 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:32.931128 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-22f53530-144b-44aa-b51d-a2b14a623332 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:32.931906 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-22f53530-144b-44aa-b51d-a2b14a623332 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:32.932382 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-22f53530-144b-44aa-b51d-a2b14a623332 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:32.950377 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:33.059361 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-22f53530-144b-44aa-b51d-a2b14a623332 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:33.067323 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-22f53530-144b-44aa-b51d-a2b14a623332 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1551 microversion: 2.1 time: 0.149078 Aug 02 21:41:33.067889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 103/222] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:32 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:33.891787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-0da3d5d7-6aa9-4886-a273-1ed86b8b2fa7 req-c8a65695-e716-46aa-bb6b-72cfa97ba590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391bbb28-e679-4c38-ac7e-11c95d7a281e", "name": "network-vif-deleted", "tag": "b77a9842-5391-4ffd-b917-1e0dcd38ced0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:33.904865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-0da3d5d7-6aa9-4886-a273-1ed86b8b2fa7 req-c8a65695-e716-46aa-bb6b-72cfa97ba590 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:33.905586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-0da3d5d7-6aa9-4886-a273-1ed86b8b2fa7 req-c8a65695-e716-46aa-bb6b-72cfa97ba590 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:33.919539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-0da3d5d7-6aa9-4886-a273-1ed86b8b2fa7 req-c8a65695-e716-46aa-bb6b-72cfa97ba590 service nova] Creating event network-vif-deleted:b77a9842-5391-4ffd-b917-1e0dcd38ced0 for instance 391bbb28-e679-4c38-ac7e-11c95d7a281e on hv-cinder-85144 Aug 02 21:41:33.938755 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-0da3d5d7-6aa9-4886-a273-1ed86b8b2fa7 req-c8a65695-e716-46aa-bb6b-72cfa97ba590 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050513 Aug 02 21:41:33.939382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 120/223] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:41:34.088599 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0df04a68-5e92-4fee-83f3-e25fb1b42a42 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:34.089140 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0df04a68-5e92-4fee-83f3-e25fb1b42a42 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:34.096282 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0df04a68-5e92-4fee-83f3-e25fb1b42a42 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:34.096745 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0df04a68-5e92-4fee-83f3-e25fb1b42a42 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:34.098014 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0df04a68-5e92-4fee-83f3-e25fb1b42a42 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:34.098458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0df04a68-5e92-4fee-83f3-e25fb1b42a42 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:34.159496 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0df04a68-5e92-4fee-83f3-e25fb1b42a42 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:34.167984 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0df04a68-5e92-4fee-83f3-e25fb1b42a42 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1344 microversion: 2.1 time: 0.083484 Aug 02 21:41:34.168581 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 104/224] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:34 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:35.194122 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-44894baf-2275-4740-ae13-1053c33fc959 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:35.195093 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-44894baf-2275-4740-ae13-1053c33fc959 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:35.202520 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44894baf-2275-4740-ae13-1053c33fc959 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:35.203188 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44894baf-2275-4740-ae13-1053c33fc959 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:35.203964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44894baf-2275-4740-ae13-1053c33fc959 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:35.204436 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44894baf-2275-4740-ae13-1053c33fc959 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:35.266011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-44894baf-2275-4740-ae13-1053c33fc959 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:35.274843 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-44894baf-2275-4740-ae13-1053c33fc959 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1344 microversion: 2.1 time: 0.089306 Aug 02 21:41:35.275402 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 121/225] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:35 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:36.296299 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b3e93845-88a5-4b1a-9b26-822ddee5ecdd tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:36.297059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b3e93845-88a5-4b1a-9b26-822ddee5ecdd tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:36.303425 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b3e93845-88a5-4b1a-9b26-822ddee5ecdd tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:36.303941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b3e93845-88a5-4b1a-9b26-822ddee5ecdd tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:36.304802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b3e93845-88a5-4b1a-9b26-822ddee5ecdd tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:36.305303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b3e93845-88a5-4b1a-9b26-822ddee5ecdd tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:36.372166 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b3e93845-88a5-4b1a-9b26-822ddee5ecdd tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:36.380984 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b3e93845-88a5-4b1a-9b26-822ddee5ecdd tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1344 microversion: 2.1 time: 0.088531 Aug 02 21:41:36.381572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 105/226] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:36 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:37.402290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a8067abc-a2ce-4a92-99c5-175a90de5bcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:37.402838 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a8067abc-a2ce-4a92-99c5-175a90de5bcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:37.404830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=36 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:37.410747 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a8067abc-a2ce-4a92-99c5-175a90de5bcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:37.411191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a8067abc-a2ce-4a92-99c5-175a90de5bcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:37.411941 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a8067abc-a2ce-4a92-99c5-175a90de5bcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:37.412394 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a8067abc-a2ce-4a92-99c5-175a90de5bcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:37.473544 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a8067abc-a2ce-4a92-99c5-175a90de5bcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:37.481289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a8067abc-a2ce-4a92-99c5-175a90de5bcf tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1344 microversion: 2.1 time: 0.083199 Aug 02 21:41:37.481843 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 122/227] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:37 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:38.502085 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2ea65b89-c6bd-40c6-9edc-eb00e95bac63 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:38.502651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2ea65b89-c6bd-40c6-9edc-eb00e95bac63 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:38.509930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ea65b89-c6bd-40c6-9edc-eb00e95bac63 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:38.510390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ea65b89-c6bd-40c6-9edc-eb00e95bac63 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:38.511170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ea65b89-c6bd-40c6-9edc-eb00e95bac63 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:38.511611 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ea65b89-c6bd-40c6-9edc-eb00e95bac63 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:38.594320 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2ea65b89-c6bd-40c6-9edc-eb00e95bac63 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:38.602352 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2ea65b89-c6bd-40c6-9edc-eb00e95bac63 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1344 microversion: 2.1 time: 0.104338 Aug 02 21:41:38.602916 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 106/228] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:38 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:39.623209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d000f1b2-1c51-486e-a0b3-9ce91e75e4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:39.623823 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d000f1b2-1c51-486e-a0b3-9ce91e75e4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:39.629804 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d000f1b2-1c51-486e-a0b3-9ce91e75e4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:39.630913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d000f1b2-1c51-486e-a0b3-9ce91e75e4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:39.631808 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d000f1b2-1c51-486e-a0b3-9ce91e75e4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:39.632279 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d000f1b2-1c51-486e-a0b3-9ce91e75e4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:39.693038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d000f1b2-1c51-486e-a0b3-9ce91e75e4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:39.700906 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d000f1b2-1c51-486e-a0b3-9ce91e75e4ae tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1344 microversion: 2.1 time: 0.081465 Aug 02 21:41:39.701466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 123/229] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:39 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:40.721477 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:40.722308 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:40.728815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:40.729470 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:40.730355 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:40.730898 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:40.765497 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:40.765951 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:40.766399 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lazy-loading 'fault' on Instance uuid 391bbb28-e679-4c38-ac7e-11c95d7a281e {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:41:40.814253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e09723da5824c2e8d7321d84a4b6bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80128fa0bb36449682b56634f82e78b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:40.821040 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8733bab8-42c3-4f66-a7d2-a5bf6878ba03 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 200 len: 1303 microversion: 2.1 time: 0.103421 Aug 02 21:41:40.821596 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 107/230] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:40 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:41.842479 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:41.843106 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:41.849277 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:41.849735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:41.850503 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:41.850946 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:41.864835 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] HTTP exception thrown: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Request method failure captured: Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e HTTP/1.1 Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm7xovz0KxLtxCV1qy9LxPpuBwtigiglEG_-6iK_a0llMuXx0uXX1Q2CLgvdlErB5kms6Kxfp-o6I_JBlQ9zfDxjUfMgf4KJwWpwxylbtGCIpqGEHyshNkvw9RKo0VPC3Z2x2GmDyFgpHjiduLt-Enw1p7ndVkfas6yxoHqZdpkQls Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 80128fa0bb36449682b56634f82e78b2 Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:41:41.869532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_80128fa0bb36449682b56634f82e78b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 80128fa0bb36449682b56634f82e78b2 Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-DeleteServersTestJSON-1481522866-project Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 4e09723da5824c2e8d7321d84a4b6bf4 Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-DeleteServersTestJSON-1481522866-project Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:41.870961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '391bbb28-e679-4c38-ac7e-11c95d7a281e'} Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:41:41.875321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:41.876454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:41.877501 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Returning 404 to user: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:41:41.877501 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-700b5ff9-e08e-47d1-89e9-255625b2fdde tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 404 len: 111 microversion: 2.1 time: 0.032584 Aug 02 21:41:41.877501 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 124/231] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:41 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:41:41.990179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:41.992750 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:42.000171 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:42.000623 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:42.001435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:42.001875 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:42.014837 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] HTTP exception thrown: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Request method failure captured: Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e/os-volume_attachments HTTP/1.1 Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7xovz0KxLtxCV1qy9LxPpuBwtigiglEG_-6iK_a0llMuXx0uXX1Q2CLgvdlErB5kms6Kxfp-o6I_JBlQ9zfDxjUfMgf4KJwWpwxylbtGCIpqGEHyshNkvw9RKo0VPC3Z2x2GmDyFgpHjiduLt-Enw1p7ndVkfas6yxoHqZdpkQls Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 80128fa0bb36449682b56634f82e78b2 Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:41:42.026344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_80128fa0bb36449682b56634f82e78b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 80128fa0bb36449682b56634f82e78b2 Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-DeleteServersTestJSON-1481522866-project Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 4e09723da5824c2e8d7321d84a4b6bf4 Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-DeleteServersTestJSON-1481522866-project Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:42.027738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'server_id': '391bbb28-e679-4c38-ac7e-11c95d7a281e'} Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:41:42.028535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:42.029799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:42.031107 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Returning 404 to user: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:41:42.031107 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c8d3c438-2400-408b-9cf5-17588fb340f7 tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042731 Aug 02 21:41:42.031107 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 108/232] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:41:41 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:41:46.403520 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:46.404049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:46.410297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:46.410750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:46.411517 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:46.411955 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:46.425472 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] HTTP exception thrown: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Request method failure captured: Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: DELETE /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e HTTP/1.1 Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm7xovz0KxLtxCV1qy9LxPpuBwtigiglEG_-6iK_a0llMuXx0uXX1Q2CLgvdlErB5kms6Kxfp-o6I_JBlQ9zfDxjUfMgf4KJwWpwxylbtGCIpqGEHyshNkvw9RKo0VPC3Z2x2GmDyFgpHjiduLt-Enw1p7ndVkfas6yxoHqZdpkQls Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 80128fa0bb36449682b56634f82e78b2 Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:41:46.426975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_80128fa0bb36449682b56634f82e78b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 80128fa0bb36449682b56634f82e78b2 Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-DeleteServersTestJSON-1481522866-project Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 4e09723da5824c2e8d7321d84a4b6bf4 Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-DeleteServersTestJSON-1481522866-project Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.428397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '391bbb28-e679-4c38-ac7e-11c95d7a281e'} Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:41:46.429184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.430404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.431751 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Returning 404 to user: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:41:46.431751 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2f13b918-0411-4b47-a907-766846240fbc tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 404 len: 111 microversion: 2.1 time: 0.029214 Aug 02 21:41:46.431751 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 125/233] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:41:46 2022] DELETE /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 21:41:46.437145 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:46.437765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] [instance: 391bbb28-e679-4c38-ac7e-11c95d7a281e] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:46.445720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:46.446171 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:46.446938 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:46.447378 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:46.460987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] HTTP exception thrown: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Request method failure captured: Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e HTTP/1.1 Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7xovz0KxLtxCV1qy9LxPpuBwtigiglEG_-6iK_a0llMuXx0uXX1Q2CLgvdlErB5kms6Kxfp-o6I_JBlQ9zfDxjUfMgf4KJwWpwxylbtGCIpqGEHyshNkvw9RKo0VPC3Z2x2GmDyFgpHjiduLt-Enw1p7ndVkfas6yxoHqZdpkQls Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 80128fa0bb36449682b56634f82e78b2 Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:41:46.463082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_80128fa0bb36449682b56634f82e78b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80128fa0bb36449682b56634f82e78b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 80128fa0bb36449682b56634f82e78b2 Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-DeleteServersTestJSON-1481522866 Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-DeleteServersTestJSON-1481522866-project Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 4e09723da5824c2e8d7321d84a4b6bf4 Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-DeleteServersTestJSON-1481522866-project Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.464467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '391bbb28-e679-4c38-ac7e-11c95d7a281e'} Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:41:46.465238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. Aug 02 21:41:46.466488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:41:46.467684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] Returning 404 to user: Instance 391bbb28-e679-4c38-ac7e-11c95d7a281e could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:41:46.467684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-25dc419a-960f-4528-8a10-f2785b6e189a tempest-DeleteServersTestJSON-1481522866 tempest-DeleteServersTestJSON-1481522866-project] 10.222.0.57 "GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e" status: 404 len: 111 microversion: 2.1 time: 0.031274 Aug 02 21:41:46.467684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 109/234] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:46 2022] GET /compute/v2.1/servers/391bbb28-e679-4c38-ac7e-11c95d7a281e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:41:55.355730 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-643748417", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:55.411160 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] validate_networks() for [('45c4aca3-fc8c-407f-af9a-44a249d5bd2d', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:41:56.083084 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:41:56.083514 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:41:56.083999 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:41:56.084976 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:41:56.085407 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:41:56.096750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:56.097893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:56.098744 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:56.099432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:56.110139 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=47 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:56.122657 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Getting quotas for project ad2873976b194c2daf265f84f5e60519. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:41:56.127073 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Getting quotas for user c9f838395a2247e49e0acacd0fdadb2b and project ad2873976b194c2daf265f84f5e60519. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:41:56.140595 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:41:56.142888 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:41:56.191779 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-60d22a8c-9195-48c7-889e-db0be2693e74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.959522 Aug 02 21:41:56.192644 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 126/235] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:41:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:41:56.204193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2910e29e-8b50-4b0d-ae5a-d540dabac8b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:56.204779 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2910e29e-8b50-4b0d-ae5a-d540dabac8b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:56.280972 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2910e29e-8b50-4b0d-ae5a-d540dabac8b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:56.287865 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2910e29e-8b50-4b0d-ae5a-d540dabac8b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1221 microversion: 2.1 time: 0.087779 Aug 02 21:41:56.300325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 110/236] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:56 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1221 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:56.351086 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1444609721", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:41:56.411662 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] validate_networks() for [('45c4aca3-fc8c-407f-af9a-44a249d5bd2d', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:41:56.871447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:41:56.872188 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:41:56.872792 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:41:56.873260 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:41:56.873741 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:41:56.883518 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:56.883978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:56.884836 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:56.885279 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:56.904166 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Getting quotas for project ad2873976b194c2daf265f84f5e60519. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:41:56.909135 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Getting quotas for user c9f838395a2247e49e0acacd0fdadb2b and project ad2873976b194c2daf265f84f5e60519. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:41:56.920305 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:41:56.922454 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:41:56.973281 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-aca3755d-d2a2-4c4a-8ae7-f50853928591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.626515 Aug 02 21:41:56.974129 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 127/237] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:41:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:41:56.985584 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2b34ee1f-2542-48a1-97a8-69295d209858 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:56.986404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2b34ee1f-2542-48a1-97a8-69295d209858 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:56.988343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=32 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:57.045397 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2b34ee1f-2542-48a1-97a8-69295d209858 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:57.052157 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2b34ee1f-2542-48a1-97a8-69295d209858 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1222 microversion: 2.1 time: 0.071118 Aug 02 21:41:57.052816 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 111/238] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:56 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1222 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:58.073272 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-40d682f1-7886-4f4c-852e-ba2a348fc165 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:58.074479 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-40d682f1-7886-4f4c-852e-ba2a348fc165 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:58.081004 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-40d682f1-7886-4f4c-852e-ba2a348fc165 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:58.081651 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-40d682f1-7886-4f4c-852e-ba2a348fc165 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:58.082553 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-40d682f1-7886-4f4c-852e-ba2a348fc165 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:58.083197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-40d682f1-7886-4f4c-852e-ba2a348fc165 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:58.149548 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-40d682f1-7886-4f4c-852e-ba2a348fc165 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:58.160111 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-40d682f1-7886-4f4c-852e-ba2a348fc165 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1274 microversion: 2.1 time: 0.089857 Aug 02 21:41:58.161065 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 128/239] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:58 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:41:59.184250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ad2eeaa6-2dae-4796-a0b7-f8fdf29c20e2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:41:59.185366 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ad2eeaa6-2dae-4796-a0b7-f8fdf29c20e2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:41:59.188381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=28 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:59.214252 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ad2eeaa6-2dae-4796-a0b7-f8fdf29c20e2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:59.222072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ad2eeaa6-2dae-4796-a0b7-f8fdf29c20e2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:59.232278 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ad2eeaa6-2dae-4796-a0b7-f8fdf29c20e2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:41:59.234468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ad2eeaa6-2dae-4796-a0b7-f8fdf29c20e2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:41:59.442949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ad2eeaa6-2dae-4796-a0b7-f8fdf29c20e2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:41:59.455763 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ad2eeaa6-2dae-4796-a0b7-f8fdf29c20e2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1280 microversion: 2.1 time: 0.276265 Aug 02 21:41:59.456758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 112/240] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:41:59 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:00.477975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7183e7fa-036f-455b-8350-ad17230003bd tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:00.479382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7183e7fa-036f-455b-8350-ad17230003bd tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:00.490338 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7183e7fa-036f-455b-8350-ad17230003bd tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:00.491696 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7183e7fa-036f-455b-8350-ad17230003bd tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:00.494740 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7183e7fa-036f-455b-8350-ad17230003bd tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:00.498112 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7183e7fa-036f-455b-8350-ad17230003bd tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:00.718053 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-a58dbd01-0b5c-4ee6-8aea-4d80454c1d90 req-a5b4a8fa-0dc8-4aa7-a4a9-3a8a5add2560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7dc5f2b-749d-4f59-8fae-f0ed0aad7517", "tag": "3e9eac3d-e456-4a44-ad24-2248cf4e97b1"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:42:00.731012 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-a58dbd01-0b5c-4ee6-8aea-4d80454c1d90 req-a5b4a8fa-0dc8-4aa7-a4a9-3a8a5add2560 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:00.732859 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-a58dbd01-0b5c-4ee6-8aea-4d80454c1d90 req-a5b4a8fa-0dc8-4aa7-a4a9-3a8a5add2560 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:00.742164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7183e7fa-036f-455b-8350-ad17230003bd tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:00.750878 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7183e7fa-036f-455b-8350-ad17230003bd tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.277373 Aug 02 21:42:00.751443 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 129/241] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:00 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:00.772343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-a58dbd01-0b5c-4ee6-8aea-4d80454c1d90 req-a5b4a8fa-0dc8-4aa7-a4a9-3a8a5add2560 service nova] Creating event network-changed:3e9eac3d-e456-4a44-ad24-2248cf4e97b1 for instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 on hv-cinder-85144 Aug 02 21:42:00.777576 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-a58dbd01-0b5c-4ee6-8aea-4d80454c1d90 req-a5b4a8fa-0dc8-4aa7-a4a9-3a8a5add2560 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065574 Aug 02 21:42:00.778169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 113/242] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:42:00.966888 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-7facd800-47ce-44df-940c-13678fe22028 req-654fe4a9-8618-45b5-91de-b45c783304bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5254075d-3708-4f10-a1cd-2a6dff86e864", "tag": "7b39e35a-5648-4684-ad8d-9d240cb19dee"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:42:00.976873 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7facd800-47ce-44df-940c-13678fe22028 req-654fe4a9-8618-45b5-91de-b45c783304bf service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:00.977325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7facd800-47ce-44df-940c-13678fe22028 req-654fe4a9-8618-45b5-91de-b45c783304bf service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:00.987958 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-7facd800-47ce-44df-940c-13678fe22028 req-654fe4a9-8618-45b5-91de-b45c783304bf service nova] Creating event network-changed:7b39e35a-5648-4684-ad8d-9d240cb19dee for instance 5254075d-3708-4f10-a1cd-2a6dff86e864 on hv-cinder-85144 Aug 02 21:42:00.993530 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-7facd800-47ce-44df-940c-13678fe22028 req-654fe4a9-8618-45b5-91de-b45c783304bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030405 Aug 02 21:42:00.994107 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 130/243] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:42:01.773668 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-907de010-3746-42d7-9419-9a313eaf2a19 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:01.774372 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-907de010-3746-42d7-9419-9a313eaf2a19 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:01.780931 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-907de010-3746-42d7-9419-9a313eaf2a19 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:01.781386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-907de010-3746-42d7-9419-9a313eaf2a19 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:01.782153 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-907de010-3746-42d7-9419-9a313eaf2a19 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:01.782592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-907de010-3746-42d7-9419-9a313eaf2a19 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:01.915839 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-907de010-3746-42d7-9419-9a313eaf2a19 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:01.923224 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-907de010-3746-42d7-9419-9a313eaf2a19 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.154270 Aug 02 21:42:01.923789 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 114/244] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:01 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:02.945423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-bd0aac05-e810-4dad-9fcc-4808de01670c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:02.946161 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-bd0aac05-e810-4dad-9fcc-4808de01670c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:02.952364 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bd0aac05-e810-4dad-9fcc-4808de01670c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:02.952818 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bd0aac05-e810-4dad-9fcc-4808de01670c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:02.953585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bd0aac05-e810-4dad-9fcc-4808de01670c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:02.954025 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bd0aac05-e810-4dad-9fcc-4808de01670c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:03.083687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-bd0aac05-e810-4dad-9fcc-4808de01670c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:03.091721 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-bd0aac05-e810-4dad-9fcc-4808de01670c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.151179 Aug 02 21:42:03.092312 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 131/245] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:02 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:04.112605 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-76c22cac-aa51-4b96-b213-b7706a7d3bc4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:04.113245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-76c22cac-aa51-4b96-b213-b7706a7d3bc4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:04.119802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-76c22cac-aa51-4b96-b213-b7706a7d3bc4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:04.120291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-76c22cac-aa51-4b96-b213-b7706a7d3bc4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:04.121185 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-76c22cac-aa51-4b96-b213-b7706a7d3bc4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:04.121630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-76c22cac-aa51-4b96-b213-b7706a7d3bc4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:04.255436 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-76c22cac-aa51-4b96-b213-b7706a7d3bc4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:04.262932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-76c22cac-aa51-4b96-b213-b7706a7d3bc4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.154292 Aug 02 21:42:04.263493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 115/246] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:04 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:05.284363 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-955797ca-caae-441f-b65f-2a42d8aa54bf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:05.284976 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-955797ca-caae-441f-b65f-2a42d8aa54bf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:05.291506 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-955797ca-caae-441f-b65f-2a42d8aa54bf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:05.291963 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-955797ca-caae-441f-b65f-2a42d8aa54bf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:05.292757 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-955797ca-caae-441f-b65f-2a42d8aa54bf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:05.293191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-955797ca-caae-441f-b65f-2a42d8aa54bf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:05.576616 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-955797ca-caae-441f-b65f-2a42d8aa54bf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:05.584579 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-955797ca-caae-441f-b65f-2a42d8aa54bf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.303529 Aug 02 21:42:05.585359 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 132/247] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:05 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:06.606257 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0042c72c-32d4-40b5-bda6-d92799be0436 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:06.606890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0042c72c-32d4-40b5-bda6-d92799be0436 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:06.613978 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0042c72c-32d4-40b5-bda6-d92799be0436 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:06.614701 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0042c72c-32d4-40b5-bda6-d92799be0436 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:06.616150 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0042c72c-32d4-40b5-bda6-d92799be0436 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:06.616751 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0042c72c-32d4-40b5-bda6-d92799be0436 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:06.751700 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0042c72c-32d4-40b5-bda6-d92799be0436 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:06.759835 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0042c72c-32d4-40b5-bda6-d92799be0436 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.157606 Aug 02 21:42:06.760435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 116/248] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:06 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:07.780607 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-376e8dc2-829a-4031-9514-b6f7fe9aadd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:07.781317 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-376e8dc2-829a-4031-9514-b6f7fe9aadd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:07.783294 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=4 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:07.783938 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=12 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:07.784597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:07.791887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-376e8dc2-829a-4031-9514-b6f7fe9aadd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:07.792410 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-376e8dc2-829a-4031-9514-b6f7fe9aadd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:07.793208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-376e8dc2-829a-4031-9514-b6f7fe9aadd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:07.793640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-376e8dc2-829a-4031-9514-b6f7fe9aadd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:07.930495 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-376e8dc2-829a-4031-9514-b6f7fe9aadd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:07.939531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-376e8dc2-829a-4031-9514-b6f7fe9aadd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.162596 Aug 02 21:42:07.940446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 133/249] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:07 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:08.962466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c858e34b-efcb-4146-9e10-21b1a374d831 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:08.963961 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c858e34b-efcb-4146-9e10-21b1a374d831 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:08.970136 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=4 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:08.972618 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c858e34b-efcb-4146-9e10-21b1a374d831 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:08.973634 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c858e34b-efcb-4146-9e10-21b1a374d831 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:08.981054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c858e34b-efcb-4146-9e10-21b1a374d831 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:08.981707 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c858e34b-efcb-4146-9e10-21b1a374d831 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:09.126998 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c858e34b-efcb-4146-9e10-21b1a374d831 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:09.135598 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c858e34b-efcb-4146-9e10-21b1a374d831 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.177605 Aug 02 21:42:09.136200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 117/250] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:08 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:10.156701 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e72a63c9-2842-4db2-b80a-5126bad73828 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:10.157333 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e72a63c9-2842-4db2-b80a-5126bad73828 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:10.163848 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e72a63c9-2842-4db2-b80a-5126bad73828 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:10.164338 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e72a63c9-2842-4db2-b80a-5126bad73828 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:10.165106 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e72a63c9-2842-4db2-b80a-5126bad73828 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:10.165539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e72a63c9-2842-4db2-b80a-5126bad73828 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:10.292636 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e72a63c9-2842-4db2-b80a-5126bad73828 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:10.299908 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e72a63c9-2842-4db2-b80a-5126bad73828 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.147163 Aug 02 21:42:10.300499 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 134/251] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:10 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:11.321136 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f75e5d8b-8d8e-4771-a299-9f111005718f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:11.321686 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f75e5d8b-8d8e-4771-a299-9f111005718f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:11.327977 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f75e5d8b-8d8e-4771-a299-9f111005718f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:11.328471 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f75e5d8b-8d8e-4771-a299-9f111005718f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:11.329242 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f75e5d8b-8d8e-4771-a299-9f111005718f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:11.329687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f75e5d8b-8d8e-4771-a299-9f111005718f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:11.453565 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f75e5d8b-8d8e-4771-a299-9f111005718f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:11.460992 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f75e5d8b-8d8e-4771-a299-9f111005718f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.143817 Aug 02 21:42:11.461551 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 118/252] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:11 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:12.481894 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-79b161a4-694c-4077-b724-39684a92683c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:12.482433 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-79b161a4-694c-4077-b724-39684a92683c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:12.488483 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-79b161a4-694c-4077-b724-39684a92683c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:12.488945 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-79b161a4-694c-4077-b724-39684a92683c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:12.489740 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-79b161a4-694c-4077-b724-39684a92683c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:12.490185 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-79b161a4-694c-4077-b724-39684a92683c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:12.617104 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-79b161a4-694c-4077-b724-39684a92683c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:12.624539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-79b161a4-694c-4077-b724-39684a92683c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.146459 Aug 02 21:42:12.625099 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 135/253] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:12 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:13.645300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7365096e-b285-4694-89d3-3d52a2c29dd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:13.645943 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7365096e-b285-4694-89d3-3d52a2c29dd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:13.652807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7365096e-b285-4694-89d3-3d52a2c29dd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:13.653254 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7365096e-b285-4694-89d3-3d52a2c29dd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:13.654012 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7365096e-b285-4694-89d3-3d52a2c29dd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:13.654443 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7365096e-b285-4694-89d3-3d52a2c29dd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:13.784336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7365096e-b285-4694-89d3-3d52a2c29dd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:13.792243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7365096e-b285-4694-89d3-3d52a2c29dd4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.150766 Aug 02 21:42:13.792801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 119/254] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:13 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:14.814293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0f26a5ff-59ed-4df5-8880-e72476e761e3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:14.814918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0f26a5ff-59ed-4df5-8880-e72476e761e3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:14.821733 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f26a5ff-59ed-4df5-8880-e72476e761e3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:14.822189 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f26a5ff-59ed-4df5-8880-e72476e761e3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:14.823018 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f26a5ff-59ed-4df5-8880-e72476e761e3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:14.823460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f26a5ff-59ed-4df5-8880-e72476e761e3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:14.954096 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0f26a5ff-59ed-4df5-8880-e72476e761e3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:14.961473 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0f26a5ff-59ed-4df5-8880-e72476e761e3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.151170 Aug 02 21:42:14.962035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 136/255] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:14 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:15.982713 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-42f4339d-f066-4e35-8e28-794b9e222dbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:15.983323 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-42f4339d-f066-4e35-8e28-794b9e222dbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:15.990660 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-42f4339d-f066-4e35-8e28-794b9e222dbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:15.991392 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-42f4339d-f066-4e35-8e28-794b9e222dbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:15.992264 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-42f4339d-f066-4e35-8e28-794b9e222dbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:15.992701 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-42f4339d-f066-4e35-8e28-794b9e222dbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:16.122831 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-42f4339d-f066-4e35-8e28-794b9e222dbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:16.130994 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-42f4339d-f066-4e35-8e28-794b9e222dbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.151572 Aug 02 21:42:16.131567 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 120/256] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:15 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:17.151335 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e0fe6f2c-7ea7-47fd-8541-68101076688c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:17.151948 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e0fe6f2c-7ea7-47fd-8541-68101076688c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:17.157990 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0fe6f2c-7ea7-47fd-8541-68101076688c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:17.158439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0fe6f2c-7ea7-47fd-8541-68101076688c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:17.159202 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0fe6f2c-7ea7-47fd-8541-68101076688c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:17.159639 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0fe6f2c-7ea7-47fd-8541-68101076688c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:17.289578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e0fe6f2c-7ea7-47fd-8541-68101076688c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:17.296909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e0fe6f2c-7ea7-47fd-8541-68101076688c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.149673 Aug 02 21:42:17.297467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 137/257] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:17 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:18.318834 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5f171e6d-73fa-405e-a26d-78261989032b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:18.319478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5f171e6d-73fa-405e-a26d-78261989032b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:18.325955 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5f171e6d-73fa-405e-a26d-78261989032b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:18.326471 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5f171e6d-73fa-405e-a26d-78261989032b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:18.327237 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5f171e6d-73fa-405e-a26d-78261989032b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:18.327676 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5f171e6d-73fa-405e-a26d-78261989032b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:18.454233 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5f171e6d-73fa-405e-a26d-78261989032b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:18.461597 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5f171e6d-73fa-405e-a26d-78261989032b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.147275 Aug 02 21:42:18.462169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 121/258] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:18 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:19.481654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-618ec94b-d2ce-4ecf-af15-e18bba428138 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:19.482269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-618ec94b-d2ce-4ecf-af15-e18bba428138 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:19.488318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-618ec94b-d2ce-4ecf-af15-e18bba428138 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:19.488773 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-618ec94b-d2ce-4ecf-af15-e18bba428138 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:19.489538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-618ec94b-d2ce-4ecf-af15-e18bba428138 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:19.489975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-618ec94b-d2ce-4ecf-af15-e18bba428138 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:19.616109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-618ec94b-d2ce-4ecf-af15-e18bba428138 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:19.623447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-618ec94b-d2ce-4ecf-af15-e18bba428138 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.145640 Aug 02 21:42:19.624007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 138/259] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:19 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:20.644678 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-265ce9f6-3677-4cc5-a0c7-8ad1e5dc924a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:20.645330 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-265ce9f6-3677-4cc5-a0c7-8ad1e5dc924a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:20.652087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-265ce9f6-3677-4cc5-a0c7-8ad1e5dc924a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:20.652563 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-265ce9f6-3677-4cc5-a0c7-8ad1e5dc924a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:20.653325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-265ce9f6-3677-4cc5-a0c7-8ad1e5dc924a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:20.653764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-265ce9f6-3677-4cc5-a0c7-8ad1e5dc924a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:20.785587 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-265ce9f6-3677-4cc5-a0c7-8ad1e5dc924a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:20.793008 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-265ce9f6-3677-4cc5-a0c7-8ad1e5dc924a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.152177 Aug 02 21:42:20.793566 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 122/260] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:20 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:21.814575 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-cb72e8a5-8e65-4dce-869d-b47e7bf28a10 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:21.815188 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-cb72e8a5-8e65-4dce-869d-b47e7bf28a10 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:21.821702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cb72e8a5-8e65-4dce-869d-b47e7bf28a10 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:21.822154 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cb72e8a5-8e65-4dce-869d-b47e7bf28a10 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:21.822919 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cb72e8a5-8e65-4dce-869d-b47e7bf28a10 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:21.823355 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cb72e8a5-8e65-4dce-869d-b47e7bf28a10 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:21.953451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cb72e8a5-8e65-4dce-869d-b47e7bf28a10 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:21.961466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-cb72e8a5-8e65-4dce-869d-b47e7bf28a10 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.150743 Aug 02 21:42:21.962031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 139/261] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:21 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:22.982060 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f3822a92-6bc8-4b91-b57d-b254b2249bdb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:22.982633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f3822a92-6bc8-4b91-b57d-b254b2249bdb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:22.990411 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f3822a92-6bc8-4b91-b57d-b254b2249bdb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:22.991030 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f3822a92-6bc8-4b91-b57d-b254b2249bdb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:22.991958 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f3822a92-6bc8-4b91-b57d-b254b2249bdb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:22.992427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f3822a92-6bc8-4b91-b57d-b254b2249bdb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:23.060581 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-90bbe4c6-12a0-4c08-8571-f890f54cf0d3 req-aafe129b-9c64-4a64-9f18-583900eed862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7dc5f2b-749d-4f59-8fae-f0ed0aad7517", "name": "network-vif-plugged", "status": "completed", "tag": "3e9eac3d-e456-4a44-ad24-2248cf4e97b1"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:42:23.071396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-90bbe4c6-12a0-4c08-8571-f890f54cf0d3 req-aafe129b-9c64-4a64-9f18-583900eed862 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:23.077380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-90bbe4c6-12a0-4c08-8571-f890f54cf0d3 req-aafe129b-9c64-4a64-9f18-583900eed862 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:23.090316 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-90bbe4c6-12a0-4c08-8571-f890f54cf0d3 req-aafe129b-9c64-4a64-9f18-583900eed862 service nova] Creating event network-vif-plugged:3e9eac3d-e456-4a44-ad24-2248cf4e97b1 for instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 on hv-cinder-85144 Aug 02 21:42:23.096096 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-90bbe4c6-12a0-4c08-8571-f890f54cf0d3 req-aafe129b-9c64-4a64-9f18-583900eed862 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039512 Aug 02 21:42:23.096653 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 140/262] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:42:23.126947 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f3822a92-6bc8-4b91-b57d-b254b2249bdb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:23.136701 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f3822a92-6bc8-4b91-b57d-b254b2249bdb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.158657 Aug 02 21:42:23.137267 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 123/263] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:22 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:24.158001 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f1ffd075-2451-492d-82f8-b4782734fddc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:24.158714 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f1ffd075-2451-492d-82f8-b4782734fddc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:24.165526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f1ffd075-2451-492d-82f8-b4782734fddc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:24.165985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f1ffd075-2451-492d-82f8-b4782734fddc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:24.166760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f1ffd075-2451-492d-82f8-b4782734fddc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:24.167222 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f1ffd075-2451-492d-82f8-b4782734fddc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:24.300731 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f1ffd075-2451-492d-82f8-b4782734fddc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:24.308265 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f1ffd075-2451-492d-82f8-b4782734fddc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.154476 Aug 02 21:42:24.308907 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 141/264] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:24 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:25.328877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2cf4926c-b416-4df9-a1f0-b43b72c98fbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:25.329508 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2cf4926c-b416-4df9-a1f0-b43b72c98fbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:25.335981 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2cf4926c-b416-4df9-a1f0-b43b72c98fbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:25.336466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2cf4926c-b416-4df9-a1f0-b43b72c98fbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:25.337235 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2cf4926c-b416-4df9-a1f0-b43b72c98fbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:25.337673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2cf4926c-b416-4df9-a1f0-b43b72c98fbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:25.465618 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2cf4926c-b416-4df9-a1f0-b43b72c98fbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:25.473120 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2cf4926c-b416-4df9-a1f0-b43b72c98fbb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.148112 Aug 02 21:42:25.473682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 124/265] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:25 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:42:26.494476 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-14b19ca0-3148-4504-b244-3ee5b00d07ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:26.495095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-14b19ca0-3148-4504-b244-3ee5b00d07ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:26.501066 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-14b19ca0-3148-4504-b244-3ee5b00d07ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:26.501578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-14b19ca0-3148-4504-b244-3ee5b00d07ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:26.502357 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-14b19ca0-3148-4504-b244-3ee5b00d07ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:26.502797 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-14b19ca0-3148-4504-b244-3ee5b00d07ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:26.507459 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=80 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:26.841230 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-14b19ca0-3148-4504-b244-3ee5b00d07ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:26.848829 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-14b19ca0-3148-4504-b244-3ee5b00d07ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.358701 Aug 02 21:42:26.849396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 142/266] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:26 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:27.869988 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-91d0300b-0d04-409f-987c-4f26d56e05eb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:27.870608 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-91d0300b-0d04-409f-987c-4f26d56e05eb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:27.877258 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-91d0300b-0d04-409f-987c-4f26d56e05eb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:27.877703 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-91d0300b-0d04-409f-987c-4f26d56e05eb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:27.878465 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-91d0300b-0d04-409f-987c-4f26d56e05eb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:27.878896 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-91d0300b-0d04-409f-987c-4f26d56e05eb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:27.883445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=75 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:28.005529 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-91d0300b-0d04-409f-987c-4f26d56e05eb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:28.013586 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-91d0300b-0d04-409f-987c-4f26d56e05eb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.147449 Aug 02 21:42:28.014157 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 125/267] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:27 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:29.034531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b3d693a8-04d5-4345-bc98-9eccd00c094d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:29.035142 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b3d693a8-04d5-4345-bc98-9eccd00c094d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:29.041345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3d693a8-04d5-4345-bc98-9eccd00c094d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:29.041802 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3d693a8-04d5-4345-bc98-9eccd00c094d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:29.042593 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3d693a8-04d5-4345-bc98-9eccd00c094d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:29.043031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3d693a8-04d5-4345-bc98-9eccd00c094d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:29.177779 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b3d693a8-04d5-4345-bc98-9eccd00c094d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:29.186442 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b3d693a8-04d5-4345-bc98-9eccd00c094d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.155639 Aug 02 21:42:29.187218 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 143/268] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:29 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:30.206817 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-63d3e42e-971d-4043-9f9a-eac1b155d1c7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:30.207570 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-63d3e42e-971d-4043-9f9a-eac1b155d1c7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:30.210633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=28 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:30.215870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63d3e42e-971d-4043-9f9a-eac1b155d1c7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:30.216430 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63d3e42e-971d-4043-9f9a-eac1b155d1c7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:30.217260 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63d3e42e-971d-4043-9f9a-eac1b155d1c7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:30.217842 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63d3e42e-971d-4043-9f9a-eac1b155d1c7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:30.403475 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-63d3e42e-971d-4043-9f9a-eac1b155d1c7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:30.410879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-63d3e42e-971d-4043-9f9a-eac1b155d1c7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.208072 Aug 02 21:42:30.411433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 126/269] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:30 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:31.431547 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c9d8ca1c-000b-4057-bdb5-59e385360a28 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:31.432177 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c9d8ca1c-000b-4057-bdb5-59e385360a28 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:31.438128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c9d8ca1c-000b-4057-bdb5-59e385360a28 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:31.438570 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c9d8ca1c-000b-4057-bdb5-59e385360a28 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:31.439327 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c9d8ca1c-000b-4057-bdb5-59e385360a28 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:31.439760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c9d8ca1c-000b-4057-bdb5-59e385360a28 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:31.572041 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c9d8ca1c-000b-4057-bdb5-59e385360a28 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:31.579585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c9d8ca1c-000b-4057-bdb5-59e385360a28 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.152573 Aug 02 21:42:31.580162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 144/270] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:31 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:32.601891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-12d30501-8be7-4453-aab5-98eff8a028d2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:32.603071 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-12d30501-8be7-4453-aab5-98eff8a028d2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:32.609559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-12d30501-8be7-4453-aab5-98eff8a028d2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:32.610002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-12d30501-8be7-4453-aab5-98eff8a028d2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:32.610770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-12d30501-8be7-4453-aab5-98eff8a028d2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:32.611202 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-12d30501-8be7-4453-aab5-98eff8a028d2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:32.747950 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-12d30501-8be7-4453-aab5-98eff8a028d2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:32.756984 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-12d30501-8be7-4453-aab5-98eff8a028d2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.160356 Aug 02 21:42:32.757559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 127/271] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:32 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:33.780747 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e8e90d9e-eb72-4b69-89e2-f60de8b1185d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:33.781363 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e8e90d9e-eb72-4b69-89e2-f60de8b1185d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:33.787804 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e8e90d9e-eb72-4b69-89e2-f60de8b1185d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:33.788473 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e8e90d9e-eb72-4b69-89e2-f60de8b1185d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:33.789290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e8e90d9e-eb72-4b69-89e2-f60de8b1185d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:33.789718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e8e90d9e-eb72-4b69-89e2-f60de8b1185d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:33.925726 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e8e90d9e-eb72-4b69-89e2-f60de8b1185d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:33.933382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e8e90d9e-eb72-4b69-89e2-f60de8b1185d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.157621 Aug 02 21:42:33.933946 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 145/272] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:33 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:34.955088 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e217bdb8-38ea-40c0-89b1-f1334392c10f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:34.955835 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e217bdb8-38ea-40c0-89b1-f1334392c10f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:34.962852 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e217bdb8-38ea-40c0-89b1-f1334392c10f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:34.963308 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e217bdb8-38ea-40c0-89b1-f1334392c10f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:34.964119 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e217bdb8-38ea-40c0-89b1-f1334392c10f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:34.964588 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e217bdb8-38ea-40c0-89b1-f1334392c10f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:35.093854 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e217bdb8-38ea-40c0-89b1-f1334392c10f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:35.102344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e217bdb8-38ea-40c0-89b1-f1334392c10f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.151296 Aug 02 21:42:35.103186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 128/273] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:34 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:36.123863 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6c7b3d38-9856-46bd-8d2c-04a143ac085e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:36.124431 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6c7b3d38-9856-46bd-8d2c-04a143ac085e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:36.130518 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6c7b3d38-9856-46bd-8d2c-04a143ac085e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:36.130964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6c7b3d38-9856-46bd-8d2c-04a143ac085e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:36.131730 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6c7b3d38-9856-46bd-8d2c-04a143ac085e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:36.132198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6c7b3d38-9856-46bd-8d2c-04a143ac085e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:36.260935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6c7b3d38-9856-46bd-8d2c-04a143ac085e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:36.268457 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6c7b3d38-9856-46bd-8d2c-04a143ac085e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.148520 Aug 02 21:42:36.269019 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 146/274] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:36 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:36.489592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-b2c7ee26-d747-4a5d-9ba3-d6dc9631e566 req-bec31881-a011-4bc2-8443-350adeaa09a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5254075d-3708-4f10-a1cd-2a6dff86e864", "name": "network-vif-plugged", "status": "completed", "tag": "7b39e35a-5648-4684-ad8d-9d240cb19dee"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:42:36.501404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-b2c7ee26-d747-4a5d-9ba3-d6dc9631e566 req-bec31881-a011-4bc2-8443-350adeaa09a2 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:36.501850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-b2c7ee26-d747-4a5d-9ba3-d6dc9631e566 req-bec31881-a011-4bc2-8443-350adeaa09a2 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:36.659129 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-b2c7ee26-d747-4a5d-9ba3-d6dc9631e566 req-bec31881-a011-4bc2-8443-350adeaa09a2 service nova] Creating event network-vif-plugged:7b39e35a-5648-4684-ad8d-9d240cb19dee for instance 5254075d-3708-4f10-a1cd-2a6dff86e864 on hv-cinder-85144 Aug 02 21:42:36.664530 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-b2c7ee26-d747-4a5d-9ba3-d6dc9631e566 req-bec31881-a011-4bc2-8443-350adeaa09a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179666 Aug 02 21:42:36.665315 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 129/275] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:42:37.289545 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-260c9c96-d8a6-4a76-bec4-b857229bd204 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:37.290154 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-260c9c96-d8a6-4a76-bec4-b857229bd204 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:37.296344 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-260c9c96-d8a6-4a76-bec4-b857229bd204 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:37.296793 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-260c9c96-d8a6-4a76-bec4-b857229bd204 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:37.297560 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-260c9c96-d8a6-4a76-bec4-b857229bd204 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:37.297991 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-260c9c96-d8a6-4a76-bec4-b857229bd204 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:37.433793 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-260c9c96-d8a6-4a76-bec4-b857229bd204 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:37.442384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-260c9c96-d8a6-4a76-bec4-b857229bd204 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.156500 Aug 02 21:42:37.455323 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 147/276] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:37 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:38.463979 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4cb30d23-7206-405f-956c-c1a1d6ea9deb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:38.464711 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4cb30d23-7206-405f-956c-c1a1d6ea9deb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:38.471340 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4cb30d23-7206-405f-956c-c1a1d6ea9deb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:38.471799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4cb30d23-7206-405f-956c-c1a1d6ea9deb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:38.472600 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4cb30d23-7206-405f-956c-c1a1d6ea9deb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:38.473042 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4cb30d23-7206-405f-956c-c1a1d6ea9deb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:38.821756 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4cb30d23-7206-405f-956c-c1a1d6ea9deb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:38.829228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4cb30d23-7206-405f-956c-c1a1d6ea9deb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1322 microversion: 2.1 time: 0.369469 Aug 02 21:42:38.829787 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 130/277] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:38 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:39.850743 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a3bc3b0e-41e8-4cf4-b43c-ef55254e8884 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:39.851266 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a3bc3b0e-41e8-4cf4-b43c-ef55254e8884 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:39.853109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=30 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:39.858594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a3bc3b0e-41e8-4cf4-b43c-ef55254e8884 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:39.859040 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a3bc3b0e-41e8-4cf4-b43c-ef55254e8884 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:39.859803 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a3bc3b0e-41e8-4cf4-b43c-ef55254e8884 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:39.860260 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a3bc3b0e-41e8-4cf4-b43c-ef55254e8884 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:39.991418 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a3bc3b0e-41e8-4cf4-b43c-ef55254e8884 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:39.999223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a3bc3b0e-41e8-4cf4-b43c-ef55254e8884 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1515 microversion: 2.1 time: 0.152394 Aug 02 21:42:39.999783 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 148/278] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:39 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:40.020640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-da097a89-10fb-43b9-a6c9-b06047f8179c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:42:40.022891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-da097a89-10fb-43b9-a6c9-b06047f8179c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:40.029178 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-da097a89-10fb-43b9-a6c9-b06047f8179c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:40.029733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-da097a89-10fb-43b9-a6c9-b06047f8179c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:40.030502 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-da097a89-10fb-43b9-a6c9-b06047f8179c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:40.030942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-da097a89-10fb-43b9-a6c9-b06047f8179c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:40.054812 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-da097a89-10fb-43b9-a6c9-b06047f8179c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lazy-loading 'flavor' on Instance uuid c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:42:40.168635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-da097a89-10fb-43b9-a6c9-b06047f8179c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517/action" status: 200 len: 32 microversion: 2.1 time: 0.152136 Aug 02 21:42:40.169631 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 131/279] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:42:40 2022] POST /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:42:40.185321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-015f3927-a79b-4150-bcb9-39689e30c8c6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:40.186210 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-015f3927-a79b-4150-bcb9-39689e30c8c6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:40.194068 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-015f3927-a79b-4150-bcb9-39689e30c8c6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:40.194526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-015f3927-a79b-4150-bcb9-39689e30c8c6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:40.195390 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-015f3927-a79b-4150-bcb9-39689e30c8c6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:40.196203 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-015f3927-a79b-4150-bcb9-39689e30c8c6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:40.378759 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-015f3927-a79b-4150-bcb9-39689e30c8c6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:40.386325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-015f3927-a79b-4150-bcb9-39689e30c8c6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.207322 Aug 02 21:42:40.386900 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 149/280] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:40 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:41.410303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0df9d926-4025-4ed1-aed9-2494f521ccd9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:41.411028 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0df9d926-4025-4ed1-aed9-2494f521ccd9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:41.418386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0df9d926-4025-4ed1-aed9-2494f521ccd9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:41.418386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0df9d926-4025-4ed1-aed9-2494f521ccd9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:41.418992 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0df9d926-4025-4ed1-aed9-2494f521ccd9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:41.419687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0df9d926-4025-4ed1-aed9-2494f521ccd9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:41.555006 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0df9d926-4025-4ed1-aed9-2494f521ccd9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:41.565124 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0df9d926-4025-4ed1-aed9-2494f521ccd9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.160907 Aug 02 21:42:41.566420 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 132/281] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:41 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:42.587610 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-47329f94-ae9b-4643-893e-b3e0a10f8e61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:42.588873 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-47329f94-ae9b-4643-893e-b3e0a10f8e61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:42.595164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47329f94-ae9b-4643-893e-b3e0a10f8e61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:42.595955 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47329f94-ae9b-4643-893e-b3e0a10f8e61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:42.596997 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47329f94-ae9b-4643-893e-b3e0a10f8e61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:42.597446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47329f94-ae9b-4643-893e-b3e0a10f8e61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:42.788043 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-47329f94-ae9b-4643-893e-b3e0a10f8e61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:42.796893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-47329f94-ae9b-4643-893e-b3e0a10f8e61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.213887 Aug 02 21:42:42.797819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 150/282] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:42 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:43.818840 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-66829e7c-6c70-4054-a84b-ad5aefa5fd78 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:43.819452 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-66829e7c-6c70-4054-a84b-ad5aefa5fd78 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:43.827762 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66829e7c-6c70-4054-a84b-ad5aefa5fd78 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:43.828275 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66829e7c-6c70-4054-a84b-ad5aefa5fd78 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:43.829049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66829e7c-6c70-4054-a84b-ad5aefa5fd78 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:43.829594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66829e7c-6c70-4054-a84b-ad5aefa5fd78 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:43.983017 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-66829e7c-6c70-4054-a84b-ad5aefa5fd78 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:43.991503 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-66829e7c-6c70-4054-a84b-ad5aefa5fd78 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.177081 Aug 02 21:42:44.004574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 133/283] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:43 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:45.013067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8d27504d-4794-456f-b1ae-4a30c337b25b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:45.013687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8d27504d-4794-456f-b1ae-4a30c337b25b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:45.019658 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8d27504d-4794-456f-b1ae-4a30c337b25b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:45.020112 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8d27504d-4794-456f-b1ae-4a30c337b25b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:45.021539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8d27504d-4794-456f-b1ae-4a30c337b25b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:45.021981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8d27504d-4794-456f-b1ae-4a30c337b25b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:45.154777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8d27504d-4794-456f-b1ae-4a30c337b25b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:45.162242 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8d27504d-4794-456f-b1ae-4a30c337b25b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.153145 Aug 02 21:42:45.162789 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 151/284] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:45 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:46.183165 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f2c5f0cc-e3e4-4fe8-a232-404eab60fe97 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:46.183774 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f2c5f0cc-e3e4-4fe8-a232-404eab60fe97 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:46.190427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f2c5f0cc-e3e4-4fe8-a232-404eab60fe97 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:46.190877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f2c5f0cc-e3e4-4fe8-a232-404eab60fe97 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:46.191636 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f2c5f0cc-e3e4-4fe8-a232-404eab60fe97 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:46.192068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f2c5f0cc-e3e4-4fe8-a232-404eab60fe97 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:46.320864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f2c5f0cc-e3e4-4fe8-a232-404eab60fe97 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:46.328233 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f2c5f0cc-e3e4-4fe8-a232-404eab60fe97 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.148878 Aug 02 21:42:46.328817 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 134/285] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:46 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:47.349847 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-34f0fbf4-3099-43fb-b7c1-8b10aa2140ae tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:47.350458 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-34f0fbf4-3099-43fb-b7c1-8b10aa2140ae tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:47.356439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34f0fbf4-3099-43fb-b7c1-8b10aa2140ae tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:47.356889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34f0fbf4-3099-43fb-b7c1-8b10aa2140ae tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:47.357646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34f0fbf4-3099-43fb-b7c1-8b10aa2140ae tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:47.358077 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34f0fbf4-3099-43fb-b7c1-8b10aa2140ae tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:47.483318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-34f0fbf4-3099-43fb-b7c1-8b10aa2140ae tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:47.491301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-34f0fbf4-3099-43fb-b7c1-8b10aa2140ae tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.145267 Aug 02 21:42:47.491857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 152/286] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:47 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:48.512181 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-30a56b35-4929-4802-ae11-b971a05e66a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:48.512800 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-30a56b35-4929-4802-ae11-b971a05e66a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:48.519364 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-30a56b35-4929-4802-ae11-b971a05e66a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:48.519824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-30a56b35-4929-4802-ae11-b971a05e66a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:48.520620 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-30a56b35-4929-4802-ae11-b971a05e66a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:48.521061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-30a56b35-4929-4802-ae11-b971a05e66a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:48.651398 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-30a56b35-4929-4802-ae11-b971a05e66a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:48.658771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-30a56b35-4929-4802-ae11-b971a05e66a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.150658 Aug 02 21:42:48.659342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 135/287] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:48 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:49.681169 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a6db5f2b-fab3-4b6b-b79b-aef6bc625143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:49.681788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a6db5f2b-fab3-4b6b-b79b-aef6bc625143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:49.687865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a6db5f2b-fab3-4b6b-b79b-aef6bc625143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:49.688377 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a6db5f2b-fab3-4b6b-b79b-aef6bc625143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:49.689157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a6db5f2b-fab3-4b6b-b79b-aef6bc625143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:49.689598 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a6db5f2b-fab3-4b6b-b79b-aef6bc625143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:49.814480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a6db5f2b-fab3-4b6b-b79b-aef6bc625143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:49.822035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a6db5f2b-fab3-4b6b-b79b-aef6bc625143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.145375 Aug 02 21:42:49.822593 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 153/288] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:49 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:50.843500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6f3be982-b774-49dd-8a89-da81a1ac81b3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:50.844118 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6f3be982-b774-49dd-8a89-da81a1ac81b3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:50.851132 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6f3be982-b774-49dd-8a89-da81a1ac81b3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:50.851588 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6f3be982-b774-49dd-8a89-da81a1ac81b3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:50.852402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6f3be982-b774-49dd-8a89-da81a1ac81b3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:50.852855 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6f3be982-b774-49dd-8a89-da81a1ac81b3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:50.995411 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6f3be982-b774-49dd-8a89-da81a1ac81b3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:51.002888 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6f3be982-b774-49dd-8a89-da81a1ac81b3 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.163315 Aug 02 21:42:51.003457 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 136/289] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:50 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:52.025305 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-63f92098-3b8b-4a6d-b939-84b2c9f0562f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:52.026013 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-63f92098-3b8b-4a6d-b939-84b2c9f0562f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:52.032056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-63f92098-3b8b-4a6d-b939-84b2c9f0562f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:52.032533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-63f92098-3b8b-4a6d-b939-84b2c9f0562f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:52.033297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-63f92098-3b8b-4a6d-b939-84b2c9f0562f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:52.033729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-63f92098-3b8b-4a6d-b939-84b2c9f0562f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:52.174078 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-63f92098-3b8b-4a6d-b939-84b2c9f0562f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:52.182155 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-63f92098-3b8b-4a6d-b939-84b2c9f0562f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.160915 Aug 02 21:42:52.182722 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 154/290] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:52 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:53.203800 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2c6e5bd9-a996-4e2f-815f-3883aa74ec6b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:53.204449 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2c6e5bd9-a996-4e2f-815f-3883aa74ec6b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:53.211540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2c6e5bd9-a996-4e2f-815f-3883aa74ec6b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:53.211943 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2c6e5bd9-a996-4e2f-815f-3883aa74ec6b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:53.212734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2c6e5bd9-a996-4e2f-815f-3883aa74ec6b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:53.213173 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2c6e5bd9-a996-4e2f-815f-3883aa74ec6b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:53.343930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2c6e5bd9-a996-4e2f-815f-3883aa74ec6b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:53.351369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2c6e5bd9-a996-4e2f-815f-3883aa74ec6b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.151381 Aug 02 21:42:53.351934 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 137/291] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:53 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:54.371393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-43c14266-dd29-4a9e-9713-e8da4021594d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:54.371940 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-43c14266-dd29-4a9e-9713-e8da4021594d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:54.378019 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-43c14266-dd29-4a9e-9713-e8da4021594d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:54.378505 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-43c14266-dd29-4a9e-9713-e8da4021594d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:54.379275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-43c14266-dd29-4a9e-9713-e8da4021594d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:54.379813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-43c14266-dd29-4a9e-9713-e8da4021594d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:54.505721 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-43c14266-dd29-4a9e-9713-e8da4021594d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:54.513150 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-43c14266-dd29-4a9e-9713-e8da4021594d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.145669 Aug 02 21:42:54.513711 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 155/292] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:54 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:55.534954 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-624050ba-13b9-4867-8771-d595adee4176 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:55.535568 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-624050ba-13b9-4867-8771-d595adee4176 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:55.542715 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-624050ba-13b9-4867-8771-d595adee4176 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:55.543163 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-624050ba-13b9-4867-8771-d595adee4176 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:55.543927 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-624050ba-13b9-4867-8771-d595adee4176 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:55.544396 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-624050ba-13b9-4867-8771-d595adee4176 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:55.680251 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-624050ba-13b9-4867-8771-d595adee4176 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:55.687660 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-624050ba-13b9-4867-8771-d595adee4176 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.156692 Aug 02 21:42:55.688238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 138/293] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:55 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:56.709135 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-34316c53-b74c-4a5d-b873-4fdee6c5cd72 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:56.709816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-34316c53-b74c-4a5d-b873-4fdee6c5cd72 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:56.715772 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34316c53-b74c-4a5d-b873-4fdee6c5cd72 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:56.716252 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34316c53-b74c-4a5d-b873-4fdee6c5cd72 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:56.717047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34316c53-b74c-4a5d-b873-4fdee6c5cd72 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:56.717479 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34316c53-b74c-4a5d-b873-4fdee6c5cd72 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:56.719950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=84 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:56.854896 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-34316c53-b74c-4a5d-b873-4fdee6c5cd72 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:56.862416 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-34316c53-b74c-4a5d-b873-4fdee6c5cd72 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.157606 Aug 02 21:42:56.862971 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 156/294] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:56 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:57.882623 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0b82b4e2-8ed3-4954-b4a8-ca013d721a50 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:57.883271 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0b82b4e2-8ed3-4954-b4a8-ca013d721a50 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:57.889743 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b82b4e2-8ed3-4954-b4a8-ca013d721a50 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:57.890198 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b82b4e2-8ed3-4954-b4a8-ca013d721a50 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:57.891000 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b82b4e2-8ed3-4954-b4a8-ca013d721a50 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:57.891441 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b82b4e2-8ed3-4954-b4a8-ca013d721a50 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:57.906367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:58.027138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0b82b4e2-8ed3-4954-b4a8-ca013d721a50 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:58.034543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0b82b4e2-8ed3-4954-b4a8-ca013d721a50 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.155789 Aug 02 21:42:58.035103 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 139/295] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:57 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:42:59.056231 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c1d862de-30df-43b1-a2ee-ade682b773ba tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:42:59.056738 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c1d862de-30df-43b1-a2ee-ade682b773ba tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:42:59.062882 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1d862de-30df-43b1-a2ee-ade682b773ba tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:59.063345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1d862de-30df-43b1-a2ee-ade682b773ba tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:59.064118 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1d862de-30df-43b1-a2ee-ade682b773ba tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:42:59.064594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1d862de-30df-43b1-a2ee-ade682b773ba tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:42:59.194724 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c1d862de-30df-43b1-a2ee-ade682b773ba tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:42:59.204214 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c1d862de-30df-43b1-a2ee-ade682b773ba tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.152442 Aug 02 21:42:59.204774 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 157/296] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:42:59 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:00.226630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ef25602a-33ee-4d1e-b336-ec7da3beda3f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:00.227248 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ef25602a-33ee-4d1e-b336-ec7da3beda3f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:00.229578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=28 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:00.234711 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef25602a-33ee-4d1e-b336-ec7da3beda3f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:00.235165 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef25602a-33ee-4d1e-b336-ec7da3beda3f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:00.235936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef25602a-33ee-4d1e-b336-ec7da3beda3f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:00.236393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef25602a-33ee-4d1e-b336-ec7da3beda3f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:00.383527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ef25602a-33ee-4d1e-b336-ec7da3beda3f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:00.391655 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ef25602a-33ee-4d1e-b336-ec7da3beda3f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.169467 Aug 02 21:43:00.392600 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 140/297] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:00 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:01.418946 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0b8a8c44-f7fe-4731-b2b6-a5f84374516d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:01.419572 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0b8a8c44-f7fe-4731-b2b6-a5f84374516d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:01.425643 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b8a8c44-f7fe-4731-b2b6-a5f84374516d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:01.426101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b8a8c44-f7fe-4731-b2b6-a5f84374516d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:01.426879 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b8a8c44-f7fe-4731-b2b6-a5f84374516d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:01.427323 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b8a8c44-f7fe-4731-b2b6-a5f84374516d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:01.575626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0b8a8c44-f7fe-4731-b2b6-a5f84374516d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:01.586184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0b8a8c44-f7fe-4731-b2b6-a5f84374516d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.176544 Aug 02 21:43:01.600679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 158/298] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:01 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:02.607166 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-094afbec-8107-4c93-aada-fc914b56cc34 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:02.608571 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-094afbec-8107-4c93-aada-fc914b56cc34 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:02.617167 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-094afbec-8107-4c93-aada-fc914b56cc34 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:02.617853 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-094afbec-8107-4c93-aada-fc914b56cc34 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:02.618758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-094afbec-8107-4c93-aada-fc914b56cc34 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:02.619208 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-094afbec-8107-4c93-aada-fc914b56cc34 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:02.764323 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-094afbec-8107-4c93-aada-fc914b56cc34 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:02.772258 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-094afbec-8107-4c93-aada-fc914b56cc34 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.168874 Aug 02 21:43:02.779162 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 141/299] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:02 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:03.793194 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f221c270-700c-4672-a768-092c980f1f7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:03.793879 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f221c270-700c-4672-a768-092c980f1f7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:03.800034 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f221c270-700c-4672-a768-092c980f1f7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:03.800654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f221c270-700c-4672-a768-092c980f1f7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:03.801440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f221c270-700c-4672-a768-092c980f1f7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:03.801878 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f221c270-700c-4672-a768-092c980f1f7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:03.972745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f221c270-700c-4672-a768-092c980f1f7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:03.985956 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f221c270-700c-4672-a768-092c980f1f7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.195476 Aug 02 21:43:03.987374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 159/300] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:03 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:05.009491 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a58aa0f3-1cb6-4c52-a893-64d7a64621f6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:05.010820 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a58aa0f3-1cb6-4c52-a893-64d7a64621f6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:05.022644 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a58aa0f3-1cb6-4c52-a893-64d7a64621f6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:05.023107 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a58aa0f3-1cb6-4c52-a893-64d7a64621f6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:05.023901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a58aa0f3-1cb6-4c52-a893-64d7a64621f6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:05.024629 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a58aa0f3-1cb6-4c52-a893-64d7a64621f6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:05.542151 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a58aa0f3-1cb6-4c52-a893-64d7a64621f6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:05.552943 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a58aa0f3-1cb6-4c52-a893-64d7a64621f6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.547957 Aug 02 21:43:05.561781 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 142/301] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:05 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:06.578267 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4dc88d31-5439-43e8-8f80-384fa34843a6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:06.578888 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4dc88d31-5439-43e8-8f80-384fa34843a6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:06.586268 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4dc88d31-5439-43e8-8f80-384fa34843a6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:06.586953 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4dc88d31-5439-43e8-8f80-384fa34843a6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:06.588008 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4dc88d31-5439-43e8-8f80-384fa34843a6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:06.588662 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4dc88d31-5439-43e8-8f80-384fa34843a6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:07.292411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4dc88d31-5439-43e8-8f80-384fa34843a6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:07.305921 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4dc88d31-5439-43e8-8f80-384fa34843a6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.733953 Aug 02 21:43:07.308518 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 160/302] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:06 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:08.336760 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7f276193-f9e1-4012-9bda-765cc44ad7b7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:08.337383 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7f276193-f9e1-4012-9bda-765cc44ad7b7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:08.366823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f276193-f9e1-4012-9bda-765cc44ad7b7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:08.373018 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f276193-f9e1-4012-9bda-765cc44ad7b7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:08.373675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f276193-f9e1-4012-9bda-765cc44ad7b7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:08.374120 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f276193-f9e1-4012-9bda-765cc44ad7b7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:08.683031 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7f276193-f9e1-4012-9bda-765cc44ad7b7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:08.693143 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7f276193-f9e1-4012-9bda-765cc44ad7b7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.363993 Aug 02 21:43:08.698135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 143/303] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:08 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:09.727588 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c4cd60ff-85c0-483c-bfa3-1eba9616e9f2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:09.729470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c4cd60ff-85c0-483c-bfa3-1eba9616e9f2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:09.746046 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4cd60ff-85c0-483c-bfa3-1eba9616e9f2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:09.746845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4cd60ff-85c0-483c-bfa3-1eba9616e9f2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:09.747806 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4cd60ff-85c0-483c-bfa3-1eba9616e9f2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:09.748442 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4cd60ff-85c0-483c-bfa3-1eba9616e9f2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:09.965827 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c4cd60ff-85c0-483c-bfa3-1eba9616e9f2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:09.988061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c4cd60ff-85c0-483c-bfa3-1eba9616e9f2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.266273 Aug 02 21:43:09.991314 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 161/304] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:09 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:11.013230 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f7db32a4-d519-4812-84e9-dbde362f97ee tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:11.014424 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f7db32a4-d519-4812-84e9-dbde362f97ee tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:11.025988 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f7db32a4-d519-4812-84e9-dbde362f97ee tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:11.027472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f7db32a4-d519-4812-84e9-dbde362f97ee tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:11.028455 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f7db32a4-d519-4812-84e9-dbde362f97ee tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:11.030902 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f7db32a4-d519-4812-84e9-dbde362f97ee tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:11.344033 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f7db32a4-d519-4812-84e9-dbde362f97ee tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:11.363306 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f7db32a4-d519-4812-84e9-dbde362f97ee tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.352818 Aug 02 21:43:11.367185 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 144/305] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:11 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:12.403227 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4fe90151-546b-401b-a32c-fc9972568903 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:12.403756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4fe90151-546b-401b-a32c-fc9972568903 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:12.411760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=28 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:12.415225 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4fe90151-546b-401b-a32c-fc9972568903 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:12.415845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4fe90151-546b-401b-a32c-fc9972568903 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:12.418577 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4fe90151-546b-401b-a32c-fc9972568903 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:12.419318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4fe90151-546b-401b-a32c-fc9972568903 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:12.849063 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4fe90151-546b-401b-a32c-fc9972568903 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:12.859762 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4fe90151-546b-401b-a32c-fc9972568903 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1521 microversion: 2.1 time: 0.460626 Aug 02 21:43:12.860377 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 162/306] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:12 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:13.886474 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d86bf7cd-fe6b-4f99-8356-f1c9b9a4a785 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:13.888465 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d86bf7cd-fe6b-4f99-8356-f1c9b9a4a785 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:13.901165 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d86bf7cd-fe6b-4f99-8356-f1c9b9a4a785 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:13.905635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d86bf7cd-fe6b-4f99-8356-f1c9b9a4a785 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:13.907904 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d86bf7cd-fe6b-4f99-8356-f1c9b9a4a785 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:13.908709 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d86bf7cd-fe6b-4f99-8356-f1c9b9a4a785 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:14.482652 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d86bf7cd-fe6b-4f99-8356-f1c9b9a4a785 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:14.493587 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d86bf7cd-fe6b-4f99-8356-f1c9b9a4a785 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1501 microversion: 2.1 time: 0.613225 Aug 02 21:43:14.494872 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 145/307] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:13 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1501 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:14.522818 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fb143658-6c9e-4d36-9a5b-2ab39608b0ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:14.523443 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-fb143658-6c9e-4d36-9a5b-2ab39608b0ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:14.531641 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fb143658-6c9e-4d36-9a5b-2ab39608b0ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:14.549226 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fb143658-6c9e-4d36-9a5b-2ab39608b0ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:14.550094 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fb143658-6c9e-4d36-9a5b-2ab39608b0ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:14.550550 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fb143658-6c9e-4d36-9a5b-2ab39608b0ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:15.109977 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-fb143658-6c9e-4d36-9a5b-2ab39608b0ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:15.127891 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-fb143658-6c9e-4d36-9a5b-2ab39608b0ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1514 microversion: 2.1 time: 0.601970 Aug 02 21:43:15.137277 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 163/308] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:14 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1514 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:17.168001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-067fd867-5cc8-47b9-adb2-181eec39389d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:17.170437 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-067fd867-5cc8-47b9-adb2-181eec39389d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:17.184736 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-067fd867-5cc8-47b9-adb2-181eec39389d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:17.185192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-067fd867-5cc8-47b9-adb2-181eec39389d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:17.186051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-067fd867-5cc8-47b9-adb2-181eec39389d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:17.186498 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-067fd867-5cc8-47b9-adb2-181eec39389d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:17.267660 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-067fd867-5cc8-47b9-adb2-181eec39389d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lazy-loading 'flavor' on Instance uuid 5254075d-3708-4f10-a1cd-2a6dff86e864 {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:43:17.429178 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-067fd867-5cc8-47b9-adb2-181eec39389d tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864/action" status: 200 len: 32 microversion: 2.1 time: 0.265152 Aug 02 21:43:17.429791 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 146/309] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:43:17 2022] POST /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:43:17.440950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1bf12119-5856-48f4-bd1d-d62be93b0d55 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:17.442133 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-1bf12119-5856-48f4-bd1d-d62be93b0d55 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:17.453733 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1bf12119-5856-48f4-bd1d-d62be93b0d55 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:17.454192 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1bf12119-5856-48f4-bd1d-d62be93b0d55 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:17.455011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1bf12119-5856-48f4-bd1d-d62be93b0d55 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:17.455474 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1bf12119-5856-48f4-bd1d-d62be93b0d55 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:18.003533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-1bf12119-5856-48f4-bd1d-d62be93b0d55 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:18.012502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1bf12119-5856-48f4-bd1d-d62be93b0d55 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.576780 Aug 02 21:43:18.016409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 164/310] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:17 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:18.270710 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d180df68-cb81-40be-99a0-9d447293721d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Action: 'create', calling method: .version_select at 0x7ff5582bf940>, body: {"keypair": {"name": "tempest-TestShelveInstance-644181576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeA0/OkIR5S8g/mZayrzRoSkb9nefB9/SxABYY2f3VOjqdAYtWUTRoF8R0qd0oiayhoMPRQYcXcCQh3iEmuTgcVwm5FbXdjFeuDEHMhDuklnYy7qMFTuWA9DJW/jV6yOg=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:18.309081 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-d180df68-cb81-40be-99a0-9d447293721d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Getting quotas for project e94861fe088e4dc091bfa76d5a100fd5. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:43:18.313325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-d180df68-cb81-40be-99a0-9d447293721d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Getting quotas for user 228eefac4dab4b5d937bf66ea6e0eb8e and project e94861fe088e4dc091bfa76d5a100fd5. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:43:18.331280 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d180df68-cb81-40be-99a0-9d447293721d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [37e6b5ed-2e87-4867-9049-ab409cca5c72] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 21:43:19.050681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-59dfffe8-41a0-4be0-883d-2e581a8f8544 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:19.051411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-59dfffe8-41a0-4be0-883d-2e581a8f8544 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:19.072629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-59dfffe8-41a0-4be0-883d-2e581a8f8544 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:19.073099 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-59dfffe8-41a0-4be0-883d-2e581a8f8544 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:19.074111 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-59dfffe8-41a0-4be0-883d-2e581a8f8544 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:19.074571 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-59dfffe8-41a0-4be0-883d-2e581a8f8544 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:19.342797 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [None req-d180df68-cb81-40be-99a0-9d447293721d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [37e6b5ed-2e87-4867-9049-ab409cca5c72] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 41204. Aug 02 21:43:19.358763 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-59dfffe8-41a0-4be0-883d-2e581a8f8544 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:19.366588 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d180df68-cb81-40be-99a0-9d447293721d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.438892 Aug 02 21:43:19.368520 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 147/311] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:43:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:43:19.389723 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-59dfffe8-41a0-4be0-883d-2e581a8f8544 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.351192 Aug 02 21:43:19.390303 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 165/312] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:19 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:19.516890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4065c98b-f5bc-42a5-b4d6-c196e6fb5912 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Action: 'create', calling method: .version_select at 0x7ff5581613a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-625758165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzk8e4cVR3uxOzQ7XxdX9OCYqnQt8+MBeqjx0x0Z2pfj3n/eaFMnvgyj7o2l362BTMnT6oxycIt1mDjhJS1jD+FsGbeTEQxXDM814GMw32EgiSLL5dYjC7PkepWGBzqdQ=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:19.540656 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-4065c98b-f5bc-42a5-b4d6-c196e6fb5912 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Getting quotas for project 0bed6dd5430c4c9983aff2e2f261f5a4. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:43:19.545700 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-4065c98b-f5bc-42a5-b4d6-c196e6fb5912 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Getting quotas for user 5377fd0bccf748dda1d0192080253dcf and project 0bed6dd5430c4c9983aff2e2f261f5a4. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:43:19.600027 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4065c98b-f5bc-42a5-b4d6-c196e6fb5912 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.229349 Aug 02 21:43:19.602255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 148/313] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:43:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:43:20.412712 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ea77918b-2ecd-4fe4-ad49-89eb200eab85 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:20.413325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ea77918b-2ecd-4fe4-ad49-89eb200eab85 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:20.431891 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ea77918b-2ecd-4fe4-ad49-89eb200eab85 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:20.432996 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ea77918b-2ecd-4fe4-ad49-89eb200eab85 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:20.434094 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ea77918b-2ecd-4fe4-ad49-89eb200eab85 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:20.434714 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ea77918b-2ecd-4fe4-ad49-89eb200eab85 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:20.701553 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ea77918b-2ecd-4fe4-ad49-89eb200eab85 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:20.717415 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ea77918b-2ecd-4fe4-ad49-89eb200eab85 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.308165 Aug 02 21:43:20.718821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 166/314] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:20 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:43:21.740944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5e8c01cd-7524-4f3e-8445-31076dcebcfc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:21.742346 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5e8c01cd-7524-4f3e-8445-31076dcebcfc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:21.750529 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e8c01cd-7524-4f3e-8445-31076dcebcfc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:21.751058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e8c01cd-7524-4f3e-8445-31076dcebcfc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:21.751923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e8c01cd-7524-4f3e-8445-31076dcebcfc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:21.752659 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e8c01cd-7524-4f3e-8445-31076dcebcfc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:21.929036 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5e8c01cd-7524-4f3e-8445-31076dcebcfc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:21.940882 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5e8c01cd-7524-4f3e-8445-31076dcebcfc tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.204934 Aug 02 21:43:21.956066 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 149/315] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:21 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:43:22.963292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-14bb6efd-d4ed-4434-b78c-54493182da61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:22.964663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-14bb6efd-d4ed-4434-b78c-54493182da61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:22.970894 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-14bb6efd-d4ed-4434-b78c-54493182da61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:22.971886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-14bb6efd-d4ed-4434-b78c-54493182da61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:22.973769 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-14bb6efd-d4ed-4434-b78c-54493182da61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:22.974443 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-14bb6efd-d4ed-4434-b78c-54493182da61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:23.116948 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-14bb6efd-d4ed-4434-b78c-54493182da61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:23.126656 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-14bb6efd-d4ed-4434-b78c-54493182da61 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.168502 Aug 02 21:43:23.127397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 167/316] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:22 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:24.151096 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ffc16a36-0259-4c56-9ada-9d19c5c0847c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:24.151831 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ffc16a36-0259-4c56-9ada-9d19c5c0847c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:24.158831 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffc16a36-0259-4c56-9ada-9d19c5c0847c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:24.159288 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffc16a36-0259-4c56-9ada-9d19c5c0847c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:24.160119 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffc16a36-0259-4c56-9ada-9d19c5c0847c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:24.160590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ffc16a36-0259-4c56-9ada-9d19c5c0847c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:24.305467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ffc16a36-0259-4c56-9ada-9d19c5c0847c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:24.313229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ffc16a36-0259-4c56-9ada-9d19c5c0847c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.166323 Aug 02 21:43:24.313820 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 150/317] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:24 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:43:25.334848 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f31cae72-c4dd-44b0-ae97-01a4a6cd3394 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:25.335461 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f31cae72-c4dd-44b0-ae97-01a4a6cd3394 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:25.341533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f31cae72-c4dd-44b0-ae97-01a4a6cd3394 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:25.341989 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f31cae72-c4dd-44b0-ae97-01a4a6cd3394 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:25.342753 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f31cae72-c4dd-44b0-ae97-01a4a6cd3394 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:25.343195 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f31cae72-c4dd-44b0-ae97-01a4a6cd3394 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:25.485209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f31cae72-c4dd-44b0-ae97-01a4a6cd3394 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:25.492578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f31cae72-c4dd-44b0-ae97-01a4a6cd3394 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.162120 Aug 02 21:43:25.493132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 168/318] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:25 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:26.515126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f273efd5-02e7-4df6-ae81-5dc0ab1182ad tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:26.515673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f273efd5-02e7-4df6-ae81-5dc0ab1182ad tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:26.522963 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f273efd5-02e7-4df6-ae81-5dc0ab1182ad tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:26.523409 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f273efd5-02e7-4df6-ae81-5dc0ab1182ad tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:26.524457 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f273efd5-02e7-4df6-ae81-5dc0ab1182ad tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:26.524890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f273efd5-02e7-4df6-ae81-5dc0ab1182ad tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:26.695186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f273efd5-02e7-4df6-ae81-5dc0ab1182ad tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:26.702594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f273efd5-02e7-4df6-ae81-5dc0ab1182ad tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.191453 Aug 02 21:43:26.703166 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 151/319] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:26 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:27.724328 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6254ff33-07b7-4733-a76a-0edd1fda5291 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:27.724951 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6254ff33-07b7-4733-a76a-0edd1fda5291 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:27.731184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6254ff33-07b7-4733-a76a-0edd1fda5291 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:27.731638 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6254ff33-07b7-4733-a76a-0edd1fda5291 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:27.732437 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6254ff33-07b7-4733-a76a-0edd1fda5291 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:27.732877 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6254ff33-07b7-4733-a76a-0edd1fda5291 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:27.735690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=78 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:27.887882 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6254ff33-07b7-4733-a76a-0edd1fda5291 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:27.905995 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6254ff33-07b7-4733-a76a-0edd1fda5291 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.186082 Aug 02 21:43:27.908174 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 169/320] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:27 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:28.930012 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-edd6a10a-ba2e-4c11-bdca-dce44c3f9963 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:28.930578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-edd6a10a-ba2e-4c11-bdca-dce44c3f9963 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:28.940557 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-edd6a10a-ba2e-4c11-bdca-dce44c3f9963 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:28.942596 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-edd6a10a-ba2e-4c11-bdca-dce44c3f9963 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:28.943415 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-edd6a10a-ba2e-4c11-bdca-dce44c3f9963 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:28.943860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-edd6a10a-ba2e-4c11-bdca-dce44c3f9963 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:28.948583 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:29.087419 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-edd6a10a-ba2e-4c11-bdca-dce44c3f9963 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:29.095565 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-edd6a10a-ba2e-4c11-bdca-dce44c3f9963 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.169968 Aug 02 21:43:29.096176 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 152/321] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:28 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:30.117309 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-be7d5e6f-b254-44e8-a1cf-596b5a30a6ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:30.117918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-be7d5e6f-b254-44e8-a1cf-596b5a30a6ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:30.124043 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be7d5e6f-b254-44e8-a1cf-596b5a30a6ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:30.124521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be7d5e6f-b254-44e8-a1cf-596b5a30a6ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:30.125281 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be7d5e6f-b254-44e8-a1cf-596b5a30a6ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:30.125712 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be7d5e6f-b254-44e8-a1cf-596b5a30a6ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:30.262221 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-be7d5e6f-b254-44e8-a1cf-596b5a30a6ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:30.270361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-be7d5e6f-b254-44e8-a1cf-596b5a30a6ed tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.157537 Aug 02 21:43:30.270926 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 170/322] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:30 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:31.292675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9998481b-eb24-49a7-8536-704a567d2274 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:31.293304 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9998481b-eb24-49a7-8536-704a567d2274 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:31.295231 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=8 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:31.296371 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:31.302064 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9998481b-eb24-49a7-8536-704a567d2274 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:31.302556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9998481b-eb24-49a7-8536-704a567d2274 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:31.303336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9998481b-eb24-49a7-8536-704a567d2274 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:31.303773 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9998481b-eb24-49a7-8536-704a567d2274 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:31.438536 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9998481b-eb24-49a7-8536-704a567d2274 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:31.446466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9998481b-eb24-49a7-8536-704a567d2274 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.157707 Aug 02 21:43:31.447032 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 153/323] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:31 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:32.468366 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-56400360-e4fb-4ea4-bdc6-8a13f8d42f17 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:32.468988 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-56400360-e4fb-4ea4-bdc6-8a13f8d42f17 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:32.476102 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-56400360-e4fb-4ea4-bdc6-8a13f8d42f17 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:32.476605 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-56400360-e4fb-4ea4-bdc6-8a13f8d42f17 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:32.477394 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-56400360-e4fb-4ea4-bdc6-8a13f8d42f17 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:32.477841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-56400360-e4fb-4ea4-bdc6-8a13f8d42f17 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:32.615554 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-56400360-e4fb-4ea4-bdc6-8a13f8d42f17 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:32.623088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-56400360-e4fb-4ea4-bdc6-8a13f8d42f17 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.158664 Aug 02 21:43:32.623655 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 171/324] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:32 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:33.077141 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 21:43:33.078154 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Tue Aug 2 21:43:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 21:43:33.644558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-63b839f8-8678-42d6-b810-0067b3a4c669 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:33.645179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-63b839f8-8678-42d6-b810-0067b3a4c669 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:33.653141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63b839f8-8678-42d6-b810-0067b3a4c669 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:33.653599 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63b839f8-8678-42d6-b810-0067b3a4c669 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:33.654416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63b839f8-8678-42d6-b810-0067b3a4c669 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:33.654879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-63b839f8-8678-42d6-b810-0067b3a4c669 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:33.792302 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-63b839f8-8678-42d6-b810-0067b3a4c669 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:33.800529 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-63b839f8-8678-42d6-b810-0067b3a4c669 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.159778 Aug 02 21:43:33.801197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 154/325] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:33 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:34.822870 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-47437fe7-02b0-4a80-92af-50de01eb6ead tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:34.823661 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-47437fe7-02b0-4a80-92af-50de01eb6ead tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:34.830239 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47437fe7-02b0-4a80-92af-50de01eb6ead tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:34.830694 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47437fe7-02b0-4a80-92af-50de01eb6ead tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:34.832005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47437fe7-02b0-4a80-92af-50de01eb6ead tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:34.832462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47437fe7-02b0-4a80-92af-50de01eb6ead tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:34.967576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-47437fe7-02b0-4a80-92af-50de01eb6ead tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:34.975812 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-47437fe7-02b0-4a80-92af-50de01eb6ead tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.157611 Aug 02 21:43:34.976398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 172/326] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:34 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:35.196461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 21:43:35.197264 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Tue Aug 2 21:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 21:43:35.997072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c64b3055-5aff-4175-b7f7-5938c05e58e5 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:35.997951 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c64b3055-5aff-4175-b7f7-5938c05e58e5 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:36.004530 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c64b3055-5aff-4175-b7f7-5938c05e58e5 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:36.004987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c64b3055-5aff-4175-b7f7-5938c05e58e5 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:36.005769 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c64b3055-5aff-4175-b7f7-5938c05e58e5 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:36.006210 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c64b3055-5aff-4175-b7f7-5938c05e58e5 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:36.139840 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c64b3055-5aff-4175-b7f7-5938c05e58e5 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:36.147473 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c64b3055-5aff-4175-b7f7-5938c05e58e5 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1500 microversion: 2.1 time: 0.154494 Aug 02 21:43:36.148039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 155/327] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:35 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:36.168943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fddb5e6d-e514-4628-8f6e-3a4e5246abc8"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:36.171257 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:36.177939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:36.178382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:36.179141 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:36.179576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:36.203469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] HTTP exception thrown: Cannot 'attach_volume' instance 5254075d-3708-4f10-a1cd-2a6dff86e864 while it is in vm_state rescued Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Request method failure captured: Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: POST /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864/os-volume_attachments HTTP/1.1 Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 74 Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZojLJbT9egEuZ8DBMGJ-XCKy-RVgSsX5Owqz-9MyiQob2d6kzqcQN2c30OKBc5PmkGknR8KsxNmw1Pz3neJWOfjR480RI1jW--uB9XwgzYzFYNwgbENme-j3Uzt7HcmMxD3f42lQJJ3XL9SA9jWOgU-EDdAyh64H0xzo83X2oh-3GA Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:43:36.205373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ad2873976b194c2daf265f84f5e60519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: c9f838395a2247e49e0acacd0fdadb2b Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {"volumeAttachment": {"volumeId": "fddb5e6d-e514-4628-8f6e-3a4e5246abc8"}} Aug 02 21:43:36.207293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Cannot 'attach_volume' instance 5254075d-3708-4f10-a1cd-2a6dff86e864 while it is in vm_state rescued Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'server_id': '5254075d-3708-4f10-a1cd-2a6dff86e864', 'body': {'volumeAttachment': {'volumeId': 'fddb5e6d-e514-4628-8f6e-3a4e5246abc8'}}} Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5254075d-3708-4f10-a1cd-2a6dff86e864 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:43:36.208021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5254075d-3708-4f10-a1cd-2a6dff86e864 while it is in vm_state rescued Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:43:36.209396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:43:36.210713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:43:36.210713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:43:36.210713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5254075d-3708-4f10-a1cd-2a6dff86e864 while it is in vm_state rescued Aug 02 21:43:36.210713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:43:36.210713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Returning 409 to user: Cannot 'attach_volume' instance 5254075d-3708-4f10-a1cd-2a6dff86e864 while it is in vm_state rescued {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:43:36.210713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9940e3bd-ec72-4f06-b50f-95e83a18bdb4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042673 Aug 02 21:43:36.210713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 173/328] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:43:36 2022] POST /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 21:43:36.216289 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-49cc5386-9c7e-4141-ae79-a5653a8990da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:36.216972 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-49cc5386-9c7e-4141-ae79-a5653a8990da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:36.223870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-49cc5386-9c7e-4141-ae79-a5653a8990da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:36.224364 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-49cc5386-9c7e-4141-ae79-a5653a8990da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:36.225168 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-49cc5386-9c7e-4141-ae79-a5653a8990da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:36.225611 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-49cc5386-9c7e-4141-ae79-a5653a8990da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:36.292830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-49cc5386-9c7e-4141-ae79-a5653a8990da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864/action" status: 202 len: 0 microversion: 2.1 time: 0.080265 Aug 02 21:43:36.293601 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 156/329] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:43:36 2022] POST /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:43:36.301730 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-da43208d-bfe3-4d6d-b328-04f9e2c32008 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:36.302344 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-da43208d-bfe3-4d6d-b328-04f9e2c32008 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:36.311463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-da43208d-bfe3-4d6d-b328-04f9e2c32008 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:36.311916 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-da43208d-bfe3-4d6d-b328-04f9e2c32008 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:36.312772 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-da43208d-bfe3-4d6d-b328-04f9e2c32008 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:36.313211 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-da43208d-bfe3-4d6d-b328-04f9e2c32008 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:36.549926 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-da43208d-bfe3-4d6d-b328-04f9e2c32008 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:36.557374 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-da43208d-bfe3-4d6d-b328-04f9e2c32008 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1508 microversion: 2.1 time: 0.259434 Aug 02 21:43:36.557932 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 174/330] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:36 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:37.580453 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7b23234c-6d0d-4a2c-ad0f-fbf532d3d6ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:37.581233 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7b23234c-6d0d-4a2c-ad0f-fbf532d3d6ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:37.587998 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b23234c-6d0d-4a2c-ad0f-fbf532d3d6ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:37.588484 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b23234c-6d0d-4a2c-ad0f-fbf532d3d6ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:37.589275 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b23234c-6d0d-4a2c-ad0f-fbf532d3d6ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:37.589712 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b23234c-6d0d-4a2c-ad0f-fbf532d3d6ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:37.726980 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7b23234c-6d0d-4a2c-ad0f-fbf532d3d6ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:37.734537 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7b23234c-6d0d-4a2c-ad0f-fbf532d3d6ef tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1508 microversion: 2.1 time: 0.158893 Aug 02 21:43:37.735142 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 157/331] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:37 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:38.757301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-698d3e6a-7c25-4d30-bf51-720a0e0fed73 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:38.757929 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-698d3e6a-7c25-4d30-bf51-720a0e0fed73 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:38.764043 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-698d3e6a-7c25-4d30-bf51-720a0e0fed73 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:38.764540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-698d3e6a-7c25-4d30-bf51-720a0e0fed73 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:38.765308 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-698d3e6a-7c25-4d30-bf51-720a0e0fed73 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:38.765750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-698d3e6a-7c25-4d30-bf51-720a0e0fed73 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:38.897063 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-698d3e6a-7c25-4d30-bf51-720a0e0fed73 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:38.904821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-698d3e6a-7c25-4d30-bf51-720a0e0fed73 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1508 microversion: 2.1 time: 0.152274 Aug 02 21:43:38.905400 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 175/332] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:38 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:39.928841 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f742c7df-e7d0-421e-9f51-f4ade96d5b63 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:39.929485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f742c7df-e7d0-421e-9f51-f4ade96d5b63 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:39.935614 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f742c7df-e7d0-421e-9f51-f4ade96d5b63 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:39.936003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f742c7df-e7d0-421e-9f51-f4ade96d5b63 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:39.936811 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f742c7df-e7d0-421e-9f51-f4ade96d5b63 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:39.937247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f742c7df-e7d0-421e-9f51-f4ade96d5b63 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:40.069072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f742c7df-e7d0-421e-9f51-f4ade96d5b63 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:40.076478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f742c7df-e7d0-421e-9f51-f4ade96d5b63 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1508 microversion: 2.1 time: 0.151682 Aug 02 21:43:40.077040 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 158/333] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:39 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:41.097821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-44da3666-762b-45c2-acd2-601897eab183 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:41.098384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-44da3666-762b-45c2-acd2-601897eab183 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:41.104432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44da3666-762b-45c2-acd2-601897eab183 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:41.104911 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44da3666-762b-45c2-acd2-601897eab183 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:41.105681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44da3666-762b-45c2-acd2-601897eab183 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:41.106119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44da3666-762b-45c2-acd2-601897eab183 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:41.258337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-44da3666-762b-45c2-acd2-601897eab183 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:41.265798 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-44da3666-762b-45c2-acd2-601897eab183 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1514 microversion: 2.1 time: 0.171927 Aug 02 21:43:41.266447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 176/334] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:41 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:43.656639 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-79edd1f6-ed8f-42f6-85f7-5ff2d19d597f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'create', calling method: .version_select at 0x7ff55806cc10>, body: {"keypair": {"name": "tempest-keypair-1098487414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2rkg+2L9GcOhcHDaZYHbUB8Ft4XF7gpPgZ+PmIzeX47KLJt5+14xK8GR6bukbbhhIGA355kiUT6bPBmQCM2FUFWUs3zkaWAnQ6eR+VD8GevajvmSXiQm6LS5TxYsyzXQ=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:43.677918 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-79edd1f6-ed8f-42f6-85f7-5ff2d19d597f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Getting quotas for project ad2873976b194c2daf265f84f5e60519. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:43:43.682036 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-79edd1f6-ed8f-42f6-85f7-5ff2d19d597f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Getting quotas for user c9f838395a2247e49e0acacd0fdadb2b and project ad2873976b194c2daf265f84f5e60519. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:43:43.704347 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-79edd1f6-ed8f-42f6-85f7-5ff2d19d597f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051534 Aug 02 21:43:43.705033 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 159/335] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:43:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:43:45.022880 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1980549011", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45c4aca3-fc8c-407f-af9a-44a249d5bd2d"}], "security_groups": [{"name": "tempest-securitygroup--7716213"}], "key_name": "tempest-keypair-1098487414", "user_data": "}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:45.031048 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=30 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:45.124349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] validate_networks() for [('45c4aca3-fc8c-407f-af9a-44a249d5bd2d', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:43:45.506857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:43:45.507291 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:43:45.507773 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:43:45.508243 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:43:45.508671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:43:45.519501 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:45.519955 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:45.520805 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:45.521246 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:45.537646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Getting quotas for project ad2873976b194c2daf265f84f5e60519. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:43:45.541510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Getting quotas for user c9f838395a2247e49e0acacd0fdadb2b and project ad2873976b194c2daf265f84f5e60519. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:43:45.553370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:43:45.555868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:43:45.603979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b12a20b6-80e0-4472-846d-37a77e58b3e8 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.585871 Aug 02 21:43:45.604563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 177/336] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:43:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 21:43:45.615955 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-243ae249-8798-46d7-8b86-e38f8199e39e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:45.616694 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-243ae249-8798-46d7-8b86-e38f8199e39e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:45.675172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-243ae249-8798-46d7-8b86-e38f8199e39e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:45.683021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-243ae249-8798-46d7-8b86-e38f8199e39e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1246 microversion: 2.1 time: 0.071476 Aug 02 21:43:45.683594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 160/337] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:45 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:46.703846 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-eaacd978-c119-4402-9a5a-76446cf3b143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:46.704409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-eaacd978-c119-4402-9a5a-76446cf3b143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:46.711096 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-eaacd978-c119-4402-9a5a-76446cf3b143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:46.711582 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-eaacd978-c119-4402-9a5a-76446cf3b143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:46.712387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-eaacd978-c119-4402-9a5a-76446cf3b143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:46.712817 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-eaacd978-c119-4402-9a5a-76446cf3b143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:46.775994 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-eaacd978-c119-4402-9a5a-76446cf3b143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:46.783256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-eaacd978-c119-4402-9a5a-76446cf3b143 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1298 microversion: 2.1 time: 0.083386 Aug 02 21:43:46.784432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 178/338] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:46 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:47.806117 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8e11189f-542b-4f2d-872a-6dc09035e1fb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:47.807104 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8e11189f-542b-4f2d-872a-6dc09035e1fb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:47.813998 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8e11189f-542b-4f2d-872a-6dc09035e1fb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:47.814531 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8e11189f-542b-4f2d-872a-6dc09035e1fb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:47.816015 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8e11189f-542b-4f2d-872a-6dc09035e1fb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:47.816535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8e11189f-542b-4f2d-872a-6dc09035e1fb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:47.887192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8e11189f-542b-4f2d-872a-6dc09035e1fb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:47.894911 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8e11189f-542b-4f2d-872a-6dc09035e1fb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1304 microversion: 2.1 time: 0.093355 Aug 02 21:43:47.895488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 161/339] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:47 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:48.712982 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-71f88738-cdf0-4875-b45c-cd98dffe87aa req-3f63f875-b4c7-4a55-9080-47b6b7a5ae1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9e4798-b622-408c-badf-10489a6cc310", "tag": "a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:48.723138 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-71f88738-cdf0-4875-b45c-cd98dffe87aa req-3f63f875-b4c7-4a55-9080-47b6b7a5ae1d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:48.723643 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-71f88738-cdf0-4875-b45c-cd98dffe87aa req-3f63f875-b4c7-4a55-9080-47b6b7a5ae1d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:48.734870 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-71f88738-cdf0-4875-b45c-cd98dffe87aa req-3f63f875-b4c7-4a55-9080-47b6b7a5ae1d service nova] Creating event network-changed:a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f for instance 3a9e4798-b622-408c-badf-10489a6cc310 on hv-cinder-85144 Aug 02 21:43:48.739902 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-71f88738-cdf0-4875-b45c-cd98dffe87aa req-3f63f875-b4c7-4a55-9080-47b6b7a5ae1d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030608 Aug 02 21:43:48.740525 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 179/340] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:43:48.917795 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1ec97109-e687-468e-9f49-00a044b69b3a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:48.918416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1ec97109-e687-468e-9f49-00a044b69b3a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:48.924917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1ec97109-e687-468e-9f49-00a044b69b3a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:48.925370 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1ec97109-e687-468e-9f49-00a044b69b3a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:48.926141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1ec97109-e687-468e-9f49-00a044b69b3a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:48.926590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1ec97109-e687-468e-9f49-00a044b69b3a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:49.080519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1ec97109-e687-468e-9f49-00a044b69b3a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:49.089072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1ec97109-e687-468e-9f49-00a044b69b3a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.175160 Aug 02 21:43:49.089710 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 162/341] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:48 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:50.110399 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f4fd6855-c677-4953-935a-66153fe46efa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:50.112557 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f4fd6855-c677-4953-935a-66153fe46efa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:50.118880 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4fd6855-c677-4953-935a-66153fe46efa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:50.119343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4fd6855-c677-4953-935a-66153fe46efa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:50.120154 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4fd6855-c677-4953-935a-66153fe46efa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:50.120594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4fd6855-c677-4953-935a-66153fe46efa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:50.249149 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f4fd6855-c677-4953-935a-66153fe46efa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:50.257052 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f4fd6855-c677-4953-935a-66153fe46efa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.150966 Aug 02 21:43:50.257609 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 180/342] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:50 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:51.278461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d54a8228-e754-4994-89d7-6793faab60da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:51.279078 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d54a8228-e754-4994-89d7-6793faab60da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:51.286245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d54a8228-e754-4994-89d7-6793faab60da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:51.286699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d54a8228-e754-4994-89d7-6793faab60da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:51.287459 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d54a8228-e754-4994-89d7-6793faab60da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:51.287905 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d54a8228-e754-4994-89d7-6793faab60da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:51.413428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d54a8228-e754-4994-89d7-6793faab60da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:51.420903 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d54a8228-e754-4994-89d7-6793faab60da tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.146295 Aug 02 21:43:51.421458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 163/343] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:51 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:52.441269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3c1490c2-0eb2-4a43-8406-41ea14e74db0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:52.441797 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3c1490c2-0eb2-4a43-8406-41ea14e74db0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:52.447721 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3c1490c2-0eb2-4a43-8406-41ea14e74db0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:52.448200 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3c1490c2-0eb2-4a43-8406-41ea14e74db0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:52.448960 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3c1490c2-0eb2-4a43-8406-41ea14e74db0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:52.449397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3c1490c2-0eb2-4a43-8406-41ea14e74db0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:52.579714 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3c1490c2-0eb2-4a43-8406-41ea14e74db0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:52.587074 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3c1490c2-0eb2-4a43-8406-41ea14e74db0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.149761 Aug 02 21:43:52.587630 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 181/344] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:52 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:43:53.608548 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c8739e89-1d31-451b-a424-84f418ebb29c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:53.609170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c8739e89-1d31-451b-a424-84f418ebb29c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:53.620899 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8739e89-1d31-451b-a424-84f418ebb29c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:53.621356 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8739e89-1d31-451b-a424-84f418ebb29c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:53.622217 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8739e89-1d31-451b-a424-84f418ebb29c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:53.622662 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8739e89-1d31-451b-a424-84f418ebb29c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:53.757112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c8739e89-1d31-451b-a424-84f418ebb29c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:53.765577 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c8739e89-1d31-451b-a424-84f418ebb29c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.161135 Aug 02 21:43:53.766138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 164/345] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:53 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:54.786707 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a6ed88ea-f5e8-449b-8062-fac0aadc01a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:54.787352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a6ed88ea-f5e8-449b-8062-fac0aadc01a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:54.793369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a6ed88ea-f5e8-449b-8062-fac0aadc01a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:54.793823 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a6ed88ea-f5e8-449b-8062-fac0aadc01a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:54.794590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a6ed88ea-f5e8-449b-8062-fac0aadc01a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:54.795061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a6ed88ea-f5e8-449b-8062-fac0aadc01a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:54.921541 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a6ed88ea-f5e8-449b-8062-fac0aadc01a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:54.929448 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a6ed88ea-f5e8-449b-8062-fac0aadc01a2 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.146597 Aug 02 21:43:54.930018 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 182/346] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:54 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:55.954957 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3930173c-d083-46c6-b64d-77386eaf7d6c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:55.955503 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3930173c-d083-46c6-b64d-77386eaf7d6c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:55.958621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=6 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:55.964468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3930173c-d083-46c6-b64d-77386eaf7d6c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:55.964834 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3930173c-d083-46c6-b64d-77386eaf7d6c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:55.965619 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3930173c-d083-46c6-b64d-77386eaf7d6c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:55.966065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3930173c-d083-46c6-b64d-77386eaf7d6c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:56.075027 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-455c699b-6ec6-40e8-bceb-d28c9cf9ffe4 req-ed44ad23-ea4c-457e-bc15-7d265d82ca57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a9e4798-b622-408c-badf-10489a6cc310", "name": "network-vif-plugged", "status": "completed", "tag": "a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:56.083603 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:56.084543 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:56.095463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-455c699b-6ec6-40e8-bceb-d28c9cf9ffe4 req-ed44ad23-ea4c-457e-bc15-7d265d82ca57 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:56.095906 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-455c699b-6ec6-40e8-bceb-d28c9cf9ffe4 req-ed44ad23-ea4c-457e-bc15-7d265d82ca57 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:56.098089 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3930173c-d083-46c6-b64d-77386eaf7d6c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:56.105735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3930173c-d083-46c6-b64d-77386eaf7d6c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.154725 Aug 02 21:43:56.106311 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 165/347] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:55 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:56.110343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-455c699b-6ec6-40e8-bceb-d28c9cf9ffe4 req-ed44ad23-ea4c-457e-bc15-7d265d82ca57 service nova] Creating event network-vif-plugged:a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f for instance 3a9e4798-b622-408c-badf-10489a6cc310 on hv-cinder-85144 Aug 02 21:43:56.116702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-455c699b-6ec6-40e8-bceb-d28c9cf9ffe4 req-ed44ad23-ea4c-457e-bc15-7d265d82ca57 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046223 Aug 02 21:43:56.117728 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 183/348] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:43:56.423305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3c01abd4-8a6b-4403-9f38-012a808c6a0e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:56.423813 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3c01abd4-8a6b-4403-9f38-012a808c6a0e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:56.430342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c01abd4-8a6b-4403-9f38-012a808c6a0e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:56.430801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c01abd4-8a6b-4403-9f38-012a808c6a0e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:56.431578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c01abd4-8a6b-4403-9f38-012a808c6a0e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:56.432020 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c01abd4-8a6b-4403-9f38-012a808c6a0e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:56.462824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3c01abd4-8a6b-4403-9f38-012a808c6a0e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/ips" status: 200 len: 152 microversion: 2.20 time: 0.043389 Aug 02 21:43:56.463574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 166/349] 10.222.0.57 () {60 vars in 1289 bytes} [Tue Aug 2 21:43:56 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:43:57.128613 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-488919c1-5e7c-4a87-8bb1-f2a86b0a2d83 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:57.129323 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-488919c1-5e7c-4a87-8bb1-f2a86b0a2d83 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:57.135512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-488919c1-5e7c-4a87-8bb1-f2a86b0a2d83 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:57.135968 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-488919c1-5e7c-4a87-8bb1-f2a86b0a2d83 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:57.136770 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-488919c1-5e7c-4a87-8bb1-f2a86b0a2d83 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:57.137216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-488919c1-5e7c-4a87-8bb1-f2a86b0a2d83 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:57.263657 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-488919c1-5e7c-4a87-8bb1-f2a86b0a2d83 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:57.271118 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-488919c1-5e7c-4a87-8bb1-f2a86b0a2d83 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.147306 Aug 02 21:43:57.271681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 184/350] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:57 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:58.292343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4367a3c0-2ab1-42ec-a0be-139ed9ea4c4c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:58.292963 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4367a3c0-2ab1-42ec-a0be-139ed9ea4c4c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:58.300304 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4367a3c0-2ab1-42ec-a0be-139ed9ea4c4c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:58.300763 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4367a3c0-2ab1-42ec-a0be-139ed9ea4c4c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:58.301531 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4367a3c0-2ab1-42ec-a0be-139ed9ea4c4c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:58.301972 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4367a3c0-2ab1-42ec-a0be-139ed9ea4c4c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:58.448004 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4367a3c0-2ab1-42ec-a0be-139ed9ea4c4c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:58.455390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4367a3c0-2ab1-42ec-a0be-139ed9ea4c4c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.167031 Aug 02 21:43:58.455942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 167/351] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:58 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:58.828589 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-54f59912-74cb-468b-b493-a7d5c6797731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:58.829158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-54f59912-74cb-468b-b493-a7d5c6797731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:58.835830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54f59912-74cb-468b-b493-a7d5c6797731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:58.836325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54f59912-74cb-468b-b493-a7d5c6797731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:58.837137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54f59912-74cb-468b-b493-a7d5c6797731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:58.837740 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54f59912-74cb-468b-b493-a7d5c6797731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:58.840200 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=82 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:58.862076 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-54f59912-74cb-468b-b493-a7d5c6797731 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/ips" status: 200 len: 145 microversion: 2.1 time: 0.038130 Aug 02 21:43:58.862654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 185/352] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:43:58 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:43:59.476103 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-cb584cb1-1e7e-471f-aa0d-c67fe4d4cc39 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:43:59.476755 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-cb584cb1-1e7e-471f-aa0d-c67fe4d4cc39 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:59.483279 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cb584cb1-1e7e-471f-aa0d-c67fe4d4cc39 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:59.483766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cb584cb1-1e7e-471f-aa0d-c67fe4d4cc39 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:59.484527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cb584cb1-1e7e-471f-aa0d-c67fe4d4cc39 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:59.485038 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cb584cb1-1e7e-471f-aa0d-c67fe4d4cc39 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:59.489543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:59.634240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-cb584cb1-1e7e-471f-aa0d-c67fe4d4cc39 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:43:59.641847 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-cb584cb1-1e7e-471f-aa0d-c67fe4d4cc39 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1369 microversion: 2.1 time: 0.169617 Aug 02 21:43:59.642446 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 168/353] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:43:59 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:43:59.756870 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-236e46c1-9181-484a-a6da-a0004966d49c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:43:59.757341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-236e46c1-9181-484a-a6da-a0004966d49c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:43:59.763290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-236e46c1-9181-484a-a6da-a0004966d49c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:59.763740 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-236e46c1-9181-484a-a6da-a0004966d49c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:59.764538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-236e46c1-9181-484a-a6da-a0004966d49c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:43:59.764980 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-236e46c1-9181-484a-a6da-a0004966d49c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:43:59.789331 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-236e46c1-9181-484a-a6da-a0004966d49c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lazy-loading 'flavor' on Instance uuid 581dd5c7-3160-47ed-ac20-6d35cbd6604c {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:44:00.030744 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-236e46c1-9181-484a-a6da-a0004966d49c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/action" status: 202 len: 0 microversion: 2.20 time: 0.277708 Aug 02 21:44:00.031345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 186/354] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 2 21:43:59 2022] POST /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:44:00.040962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:00.041573 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:00.047670 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:00.048230 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:00.049170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:00.050349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:00.183051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:00.191037 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:00.192628 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:00.193786 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-380e0385-07c0-4e83-9fe7-95ce453ba14e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.157032 Aug 02 21:44:00.194342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 169/355] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:00 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:00.445650 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5369e953-df76-4024-83a4-55d21ed1558a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:00.446245 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5369e953-df76-4024-83a4-55d21ed1558a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:00.453101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5369e953-df76-4024-83a4-55d21ed1558a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:00.453560 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5369e953-df76-4024-83a4-55d21ed1558a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:00.454337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5369e953-df76-4024-83a4-55d21ed1558a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:00.454782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5369e953-df76-4024-83a4-55d21ed1558a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:00.477887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5369e953-df76-4024-83a4-55d21ed1558a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/ips" status: 200 len: 150 microversion: 2.1 time: 0.036507 Aug 02 21:44:00.478432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 187/356] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:44:00 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:00.663301 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-96a372d0-136f-471a-bced-1801f58df5b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:00.664088 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-96a372d0-136f-471a-bced-1801f58df5b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:00.671024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-96a372d0-136f-471a-bced-1801f58df5b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:00.671472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-96a372d0-136f-471a-bced-1801f58df5b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:00.672291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-96a372d0-136f-471a-bced-1801f58df5b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:00.672926 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-96a372d0-136f-471a-bced-1801f58df5b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:00.822379 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-96a372d0-136f-471a-bced-1801f58df5b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:00.831204 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-96a372d0-136f-471a-bced-1801f58df5b6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1563 microversion: 2.1 time: 0.171791 Aug 02 21:44:00.831761 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 170/357] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:00 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:00.851786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-bb51554c-2524-4e08-b9a8-693a5f487464 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:00.852321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-bb51554c-2524-4e08-b9a8-693a5f487464 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:00.858254 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bb51554c-2524-4e08-b9a8-693a5f487464 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:00.858697 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bb51554c-2524-4e08-b9a8-693a5f487464 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:00.859452 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bb51554c-2524-4e08-b9a8-693a5f487464 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:00.859886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bb51554c-2524-4e08-b9a8-693a5f487464 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:00.939409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-bb51554c-2524-4e08-b9a8-693a5f487464 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091673 Aug 02 21:44:00.940676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 188/358] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 2 21:44:00 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:01.217799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:01.218342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:01.224390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:01.224848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:01.225614 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:01.226236 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:01.358901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:01.367485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:01.369079 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:01.370242 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e55afd82-40ec-4fa7-a850-fb6c343f60e8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.156648 Aug 02 21:44:01.370793 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 171/359] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:01 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:01.904169 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-b7647e84-b792-42cf-a154-97c7e26a3ad9 req-959dcc79-51fd-43cc-87a8-dc4415eb8655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9e4798-b622-408c-badf-10489a6cc310", "tag": "a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:01.922151 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-b7647e84-b792-42cf-a154-97c7e26a3ad9 req-959dcc79-51fd-43cc-87a8-dc4415eb8655 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:01.922664 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-b7647e84-b792-42cf-a154-97c7e26a3ad9 req-959dcc79-51fd-43cc-87a8-dc4415eb8655 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:01.936865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-b7647e84-b792-42cf-a154-97c7e26a3ad9 req-959dcc79-51fd-43cc-87a8-dc4415eb8655 service nova] Creating event network-changed:a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f for instance 3a9e4798-b622-408c-badf-10489a6cc310 on hv-cinder-85144 Aug 02 21:44:01.945604 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-b7647e84-b792-42cf-a154-97c7e26a3ad9 req-959dcc79-51fd-43cc-87a8-dc4415eb8655 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045065 Aug 02 21:44:01.947676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 189/360] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:02.392850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:02.393621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:02.397820 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:02.404266 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:02.404937 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:02.406098 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:02.406646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:02.776328 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:02.785274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:02.786900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:02.788669 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bed73019-ad7b-441b-8350-e32372aa6f42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.399478 Aug 02 21:44:02.789398 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 172/361] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:02 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:02.926248 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-09e5447b-3538-4e2f-b90c-31a3877bdd9e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ee4dcfc-220e-436b-87f8-4fa8fe61197b"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:02.928909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-09e5447b-3538-4e2f-b90c-31a3877bdd9e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:02.935467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-09e5447b-3538-4e2f-b90c-31a3877bdd9e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:02.936186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-09e5447b-3538-4e2f-b90c-31a3877bdd9e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:02.937065 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-09e5447b-3538-4e2f-b90c-31a3877bdd9e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:02.937666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-09e5447b-3538-4e2f-b90c-31a3877bdd9e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:03.226286 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-09e5447b-3538-4e2f-b90c-31a3877bdd9e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304457 Aug 02 21:44:03.226985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 190/362] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:44:02 2022] POST /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:03.815152 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:03.815780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:03.823580 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:03.824051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:03.824854 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:03.825303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:03.956443 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:03.964441 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:03.965977 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:03.967142 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fa946504-e413-4ec3-93eb-b5c861965ea1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.155993 Aug 02 21:44:03.967689 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 173/363] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:03 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:04.175421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3a85fd55-f67c-4002-a599-c054e61dd332 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c1b1368-bbea-470a-8506-fa8fd0a292bb"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:04.178716 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3a85fd55-f67c-4002-a599-c054e61dd332 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:04.185154 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3a85fd55-f67c-4002-a599-c054e61dd332 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:04.185642 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3a85fd55-f67c-4002-a599-c054e61dd332 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:04.186571 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3a85fd55-f67c-4002-a599-c054e61dd332 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:04.187075 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3a85fd55-f67c-4002-a599-c054e61dd332 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:04.639841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3a85fd55-f67c-4002-a599-c054e61dd332 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469132 Aug 02 21:44:04.640477 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 191/364] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:44:04 2022] POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:04.990958 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:04.991564 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:04.998411 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:04.998858 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:04.999650 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:05.000091 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:05.143862 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:05.153215 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:05.154841 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:05.156093 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-26a5cdb2-98a1-4338-85e1-9edee5c53c3b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.169160 Aug 02 21:44:05.156683 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 174/365] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:04 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:05.880426 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-13193407", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-644181576", "security_groups": [{"name": "tempest-secgroup-smoke-1181049016"}], "networks": [{"uuid": "9a349214-01ac-46ed-bd5f-9155c3704ff3"}], "block_device_mapping_v2": [{"uuid": "d3c1b933-7225-4e9e-9e23-603205be625e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:06.011931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] validate_networks() for [('9a349214-01ac-46ed-bd5f-9155c3704ff3', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:44:06.181026 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:06.181651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:06.189049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:06.189465 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:06.190416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:06.191218 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:06.350984 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:06.360919 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:06.364170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:06.365886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-43ef694c-c1a5-410f-920d-d5970bde484f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.190156 Aug 02 21:44:06.367024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 175/366] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:06 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:06.861519 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:44:06.862022 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:44:06.862578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:44:06.863130 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:44:06.863622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:44:06.873158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:06.873692 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:06.874572 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:06.875085 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:06.893990 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Getting quotas for project e94861fe088e4dc091bfa76d5a100fd5. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:44:06.898792 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Getting quotas for user 228eefac4dab4b5d937bf66ea6e0eb8e and project e94861fe088e4dc091bfa76d5a100fd5. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:44:06.955371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:44:06.957612 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3c1b933-7225-4e9e-9e23-603205be625e',volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:44:07.098967 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4644e58a-61ab-4662-b1da-c102bd040141 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.223116 Aug 02 21:44:07.099622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 192/367] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:44:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:44:07.110404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-68b07857-9162-4aa2-822c-5be75928e31a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:07.111024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-68b07857-9162-4aa2-822c-5be75928e31a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:07.167021 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-68b07857-9162-4aa2-822c-5be75928e31a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:07.173838 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-68b07857-9162-4aa2-822c-5be75928e31a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1086 microversion: 2.1 time: 0.067349 Aug 02 21:44:07.174411 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 176/368] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:07 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1086 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:07.389336 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:07.390041 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:07.397038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:07.397491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:07.398523 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:07.398974 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:07.534419 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:07.543068 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:07.544618 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:07.545778 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c8893592-909a-4477-ae70-cb11f8933ddc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.160505 Aug 02 21:44:07.546336 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 193/369] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:07 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:08.195435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a4f5e61d-2099-463c-a143-25c195245d3c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:08.196110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a4f5e61d-2099-463c-a143-25c195245d3c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:08.203537 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a4f5e61d-2099-463c-a143-25c195245d3c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:08.203990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a4f5e61d-2099-463c-a143-25c195245d3c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:08.204829 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a4f5e61d-2099-463c-a143-25c195245d3c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:08.205287 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a4f5e61d-2099-463c-a143-25c195245d3c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:08.271114 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a4f5e61d-2099-463c-a143-25c195245d3c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:08.280495 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a4f5e61d-2099-463c-a143-25c195245d3c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1192 microversion: 2.1 time: 0.089879 Aug 02 21:44:08.281070 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 177/370] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:08 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:08.569646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:08.570268 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:08.577726 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:08.578558 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:08.580391 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:08.581020 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:08.814796 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:08.823751 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:08.825400 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:08.826594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b3835af1-2acb-4c0d-bb2b-ce4a62b0a683 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.261602 Aug 02 21:44:08.827523 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 194/371] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:08 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:09.242619 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1948268490", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-625758165", "security_groups": [{"name": "tempest-secgroup-smoke-810633011"}], "block_device_mapping_v2": [{"uuid": "49b65513-8104-439b-9d18-fc1aed90088b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3520a454-3079-4cee-a49b-0583c4633c25"}]}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:09.302317 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ece1a8bd-b876-4709-be4a-72f21523e476 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:09.303024 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ece1a8bd-b876-4709-be4a-72f21523e476 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:09.309382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ece1a8bd-b876-4709-be4a-72f21523e476 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:09.309836 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ece1a8bd-b876-4709-be4a-72f21523e476 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:09.310622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ece1a8bd-b876-4709-be4a-72f21523e476 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:09.311066 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ece1a8bd-b876-4709-be4a-72f21523e476 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:09.362848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] validate_networks() for [('3520a454-3079-4cee-a49b-0583c4633c25', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:44:09.572848 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ece1a8bd-b876-4709-be4a-72f21523e476 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:09.582970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ece1a8bd-b876-4709-be4a-72f21523e476 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.285411 Aug 02 21:44:09.583622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 195/372] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:09 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:09.684362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-4604dc19-e533-4d04-b275-df55262d4553 req-ea994ea0-ee2e-40c6-9a64-3d3bb95b172d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7248b87b-aba6-40d9-b464-f824c44b1672", "tag": "5a4b7f07-13e7-408e-b7d9-3162f37424ed"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:09.694814 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-4604dc19-e533-4d04-b275-df55262d4553 req-ea994ea0-ee2e-40c6-9a64-3d3bb95b172d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:09.695359 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-4604dc19-e533-4d04-b275-df55262d4553 req-ea994ea0-ee2e-40c6-9a64-3d3bb95b172d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:09.708164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-4604dc19-e533-4d04-b275-df55262d4553 req-ea994ea0-ee2e-40c6-9a64-3d3bb95b172d service nova] Creating event network-changed:5a4b7f07-13e7-408e-b7d9-3162f37424ed for instance 7248b87b-aba6-40d9-b464-f824c44b1672 on hv-cinder-85144 Aug 02 21:44:09.714338 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-4604dc19-e533-4d04-b275-df55262d4553 req-ea994ea0-ee2e-40c6-9a64-3d3bb95b172d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033822 Aug 02 21:44:09.716086 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 196/373] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:44:09.756483 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:44:09.756921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:44:09.757399 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:44:09.757813 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:44:09.758266 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:44:09.767047 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:09.767498 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:09.768361 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:09.768803 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:09.786007 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Getting quotas for project 0bed6dd5430c4c9983aff2e2f261f5a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:44:09.790067 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Getting quotas for user 5377fd0bccf748dda1d0192080253dcf and project 0bed6dd5430c4c9983aff2e2f261f5a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:44:09.847338 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:44:09.849520 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49b65513-8104-439b-9d18-fc1aed90088b',volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:44:09.851622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:09.852451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:09.859820 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:09.860323 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:09.861153 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:09.861602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:09.982644 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fb4ea712-8119-447e-9393-e1f1ff4416a4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.744057 Aug 02 21:44:09.983279 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 178/374] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:44:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:44:09.994760 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5ad94560-fe3b-43e7-8b12-827109740e3c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:09.996065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5ad94560-fe3b-43e7-8b12-827109740e3c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:10.030561 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:10.039450 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:10.041198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:10.044852 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-92cb109a-28f9-4b16-bb26-56a123610df7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.197757 Aug 02 21:44:10.048244 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 197/375] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:09 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:10.064559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5ad94560-fe3b-43e7-8b12-827109740e3c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:10.071685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5ad94560-fe3b-43e7-8b12-827109740e3c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1094 microversion: 2.1 time: 0.081041 Aug 02 21:44:10.072278 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 179/376] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:09 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:10.604665 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-03ffe94d-b5f6-4607-9ccb-62efafd89eed tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:10.605434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-03ffe94d-b5f6-4607-9ccb-62efafd89eed tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:10.612029 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-03ffe94d-b5f6-4607-9ccb-62efafd89eed tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:10.612519 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-03ffe94d-b5f6-4607-9ccb-62efafd89eed tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:10.613943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-03ffe94d-b5f6-4607-9ccb-62efafd89eed tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:10.614379 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-03ffe94d-b5f6-4607-9ccb-62efafd89eed tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:10.743718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-03ffe94d-b5f6-4607-9ccb-62efafd89eed tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:10.751188 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-03ffe94d-b5f6-4607-9ccb-62efafd89eed tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.150481 Aug 02 21:44:10.751745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 198/377] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:10 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:11.068492 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:11.069127 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:11.075532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:11.075991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:11.076794 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:11.077242 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:11.092702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9f69790f-e542-4d45-b1cf-ba8efb259b66 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:11.093579 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9f69790f-e542-4d45-b1cf-ba8efb259b66 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:11.099599 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9f69790f-e542-4d45-b1cf-ba8efb259b66 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:11.100049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9f69790f-e542-4d45-b1cf-ba8efb259b66 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:11.100854 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9f69790f-e542-4d45-b1cf-ba8efb259b66 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:11.101287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9f69790f-e542-4d45-b1cf-ba8efb259b66 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:11.162158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9f69790f-e542-4d45-b1cf-ba8efb259b66 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:11.169483 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9f69790f-e542-4d45-b1cf-ba8efb259b66 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1144 microversion: 2.1 time: 0.080575 Aug 02 21:44:11.170038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 199/378] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:11 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:11.211519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:11.219460 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:11.221044 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:11.222204 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-07afe106-72ab-4ebd-a2a3-ee8a1d73b37e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.158212 Aug 02 21:44:11.223266 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 180/379] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:11 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:11.771626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1c2194d4-8902-4201-acdc-12d434e135aa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:11.772268 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-1c2194d4-8902-4201-acdc-12d434e135aa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:11.778966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1c2194d4-8902-4201-acdc-12d434e135aa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:11.779413 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1c2194d4-8902-4201-acdc-12d434e135aa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:11.780197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1c2194d4-8902-4201-acdc-12d434e135aa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:11.780633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1c2194d4-8902-4201-acdc-12d434e135aa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:11.783267 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:11.917975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-1c2194d4-8902-4201-acdc-12d434e135aa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:11.925368 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1c2194d4-8902-4201-acdc-12d434e135aa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.158190 Aug 02 21:44:11.925924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 200/380] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:11 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:12.190386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7b31af0e-0bd2-4579-8404-37ceeb192f39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:12.190951 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7b31af0e-0bd2-4579-8404-37ceeb192f39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:12.198229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b31af0e-0bd2-4579-8404-37ceeb192f39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:12.198679 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b31af0e-0bd2-4579-8404-37ceeb192f39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:12.199443 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b31af0e-0bd2-4579-8404-37ceeb192f39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:12.199870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b31af0e-0bd2-4579-8404-37ceeb192f39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:12.249267 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:12.249800 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:12.256645 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:12.257105 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:12.257895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:12.258346 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:12.261186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7b31af0e-0bd2-4579-8404-37ceeb192f39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:12.268622 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7b31af0e-0bd2-4579-8404-37ceeb192f39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1144 microversion: 2.1 time: 0.082989 Aug 02 21:44:12.269185 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 181/381] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:12 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:12.384365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:12.392179 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:12.393726 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:12.394922 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5a00da7d-a7b5-4b9a-b9f3-9937ac597357 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.149641 Aug 02 21:44:12.395478 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 201/382] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:12 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:12.946088 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-008a160d-0321-40a8-b470-2ad491b7a0df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:12.946713 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-008a160d-0321-40a8-b470-2ad491b7a0df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:12.952770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-008a160d-0321-40a8-b470-2ad491b7a0df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:12.953208 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-008a160d-0321-40a8-b470-2ad491b7a0df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:12.953975 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-008a160d-0321-40a8-b470-2ad491b7a0df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:12.954423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-008a160d-0321-40a8-b470-2ad491b7a0df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:13.084627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-008a160d-0321-40a8-b470-2ad491b7a0df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:13.092010 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-008a160d-0321-40a8-b470-2ad491b7a0df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.149867 Aug 02 21:44:13.092604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 182/383] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:12 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:13.288644 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3e9292ab-25b1-4f90-b370-17e132946fba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:13.289267 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3e9292ab-25b1-4f90-b370-17e132946fba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:13.295848 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e9292ab-25b1-4f90-b370-17e132946fba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:13.296337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e9292ab-25b1-4f90-b370-17e132946fba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:13.297106 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e9292ab-25b1-4f90-b370-17e132946fba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:13.297547 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e9292ab-25b1-4f90-b370-17e132946fba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:13.362002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3e9292ab-25b1-4f90-b370-17e132946fba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:13.369467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3e9292ab-25b1-4f90-b370-17e132946fba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1144 microversion: 2.1 time: 0.084713 Aug 02 21:44:13.370021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 202/384] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:13 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:13.418064 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:13.418686 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:13.425097 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:13.425552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:13.426324 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:13.426769 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:13.566636 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:13.576215 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:13.577776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:13.578938 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2d512e13-b72e-453a-9bab-1511d76e1b3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.165118 Aug 02 21:44:13.579493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 183/385] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:13 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:14.114186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d8882208-25cb-4184-bf64-2e75ac3b901b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:14.114732 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d8882208-25cb-4184-bf64-2e75ac3b901b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:14.120626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d8882208-25cb-4184-bf64-2e75ac3b901b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:14.121082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d8882208-25cb-4184-bf64-2e75ac3b901b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:14.121852 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d8882208-25cb-4184-bf64-2e75ac3b901b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:14.122295 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d8882208-25cb-4184-bf64-2e75ac3b901b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:14.264553 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d8882208-25cb-4184-bf64-2e75ac3b901b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:14.272046 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d8882208-25cb-4184-bf64-2e75ac3b901b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.162769 Aug 02 21:44:14.272685 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 203/386] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:14 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:14.390920 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7af10de4-514c-4e69-afbf-b69b7ecc803a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:14.391466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7af10de4-514c-4e69-afbf-b69b7ecc803a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:14.398347 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7af10de4-514c-4e69-afbf-b69b7ecc803a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:14.398799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7af10de4-514c-4e69-afbf-b69b7ecc803a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:14.399563 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7af10de4-514c-4e69-afbf-b69b7ecc803a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:14.400001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7af10de4-514c-4e69-afbf-b69b7ecc803a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:14.459141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7af10de4-514c-4e69-afbf-b69b7ecc803a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:14.466491 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7af10de4-514c-4e69-afbf-b69b7ecc803a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1144 microversion: 2.1 time: 0.079564 Aug 02 21:44:14.467050 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 184/387] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:14 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:14.603719 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:14.604555 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:14.611903 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:14.612470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:14.613237 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:14.613685 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:14.744087 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:14.751908 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:14.753938 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:14.755095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d6cbc322-b9a4-4436-b5aa-a9062517e7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.155351 Aug 02 21:44:14.755643 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 204/388] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:14 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:15.298996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ef861adf-14e4-4cbb-bad1-dc92549cdcaa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:15.298996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ef861adf-14e4-4cbb-bad1-dc92549cdcaa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:15.299835 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef861adf-14e4-4cbb-bad1-dc92549cdcaa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:15.300925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef861adf-14e4-4cbb-bad1-dc92549cdcaa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:15.301813 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef861adf-14e4-4cbb-bad1-dc92549cdcaa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:15.302332 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ef861adf-14e4-4cbb-bad1-dc92549cdcaa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:15.436627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ef861adf-14e4-4cbb-bad1-dc92549cdcaa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:15.444646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ef861adf-14e4-4cbb-bad1-dc92549cdcaa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.156408 Aug 02 21:44:15.445212 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 185/389] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:15 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:15.488267 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-701d28bb-91bc-4184-ba85-a1c0a2c57d89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:15.488856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-701d28bb-91bc-4184-ba85-a1c0a2c57d89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:15.490681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:15.495898 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-701d28bb-91bc-4184-ba85-a1c0a2c57d89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:15.496380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-701d28bb-91bc-4184-ba85-a1c0a2c57d89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:15.497172 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-701d28bb-91bc-4184-ba85-a1c0a2c57d89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:15.497597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-701d28bb-91bc-4184-ba85-a1c0a2c57d89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:15.563409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-701d28bb-91bc-4184-ba85-a1c0a2c57d89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:15.571160 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-701d28bb-91bc-4184-ba85-a1c0a2c57d89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1144 microversion: 2.1 time: 0.087176 Aug 02 21:44:15.571735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 205/390] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:15 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:15.779466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:15.780016 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:15.786575 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:15.787032 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:15.787799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:15.788274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:15.918739 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:15.926886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:15.928469 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:15.929645 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-539c6ce7-9207-47a4-8adc-698d24822c0c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.154312 Aug 02 21:44:15.930205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 186/391] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:15 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:16.464423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1b8c5538-2f24-447d-9c20-9a14dd74135d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:16.465304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-1b8c5538-2f24-447d-9c20-9a14dd74135d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:16.472031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1b8c5538-2f24-447d-9c20-9a14dd74135d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:16.472535 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1b8c5538-2f24-447d-9c20-9a14dd74135d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:16.473301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1b8c5538-2f24-447d-9c20-9a14dd74135d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:16.473736 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1b8c5538-2f24-447d-9c20-9a14dd74135d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:16.592314 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-81a35080-3f71-4302-a6dc-e9dbd38ab806 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:16.592979 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-81a35080-3f71-4302-a6dc-e9dbd38ab806 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:16.600110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81a35080-3f71-4302-a6dc-e9dbd38ab806 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:16.600651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81a35080-3f71-4302-a6dc-e9dbd38ab806 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:16.601530 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81a35080-3f71-4302-a6dc-e9dbd38ab806 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:16.602035 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81a35080-3f71-4302-a6dc-e9dbd38ab806 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:16.610088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-1b8c5538-2f24-447d-9c20-9a14dd74135d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:16.617724 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1b8c5538-2f24-447d-9c20-9a14dd74135d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.157068 Aug 02 21:44:16.618299 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 206/392] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:16 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:16.619634 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=100 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:16.666132 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-81a35080-3f71-4302-a6dc-e9dbd38ab806 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:16.673448 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-81a35080-3f71-4302-a6dc-e9dbd38ab806 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1144 microversion: 2.1 time: 0.085068 Aug 02 21:44:16.674012 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 187/393] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:16 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:16.951405 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:16.952175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:16.953995 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:16.954690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:16.960635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:16.961088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:16.961893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:16.962415 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:17.090102 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:17.098396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:17.099902 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:17.101100 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a188cd82-8a39-4493-ad2c-bf9e6f90cda8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.153593 Aug 02 21:44:17.101652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 207/394] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:16 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:17.638732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c81cfe8c-56b1-4806-a3f2-420755d16b3b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:17.639425 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c81cfe8c-56b1-4806-a3f2-420755d16b3b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:17.646000 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c81cfe8c-56b1-4806-a3f2-420755d16b3b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:17.646454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c81cfe8c-56b1-4806-a3f2-420755d16b3b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:17.647226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c81cfe8c-56b1-4806-a3f2-420755d16b3b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:17.647666 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c81cfe8c-56b1-4806-a3f2-420755d16b3b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:17.696836 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-44a83df0-bd18-4dc6-a8e7-3b3edb14652f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:17.697456 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-44a83df0-bd18-4dc6-a8e7-3b3edb14652f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:17.704045 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44a83df0-bd18-4dc6-a8e7-3b3edb14652f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:17.706069 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44a83df0-bd18-4dc6-a8e7-3b3edb14652f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:17.706883 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44a83df0-bd18-4dc6-a8e7-3b3edb14652f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:17.707402 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44a83df0-bd18-4dc6-a8e7-3b3edb14652f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:17.773663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-44a83df0-bd18-4dc6-a8e7-3b3edb14652f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:17.781293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-44a83df0-bd18-4dc6-a8e7-3b3edb14652f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1144 microversion: 2.1 time: 0.088187 Aug 02 21:44:17.781855 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 208/395] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:17 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:17.789851 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c81cfe8c-56b1-4806-a3f2-420755d16b3b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:17.797280 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c81cfe8c-56b1-4806-a3f2-420755d16b3b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.162460 Aug 02 21:44:17.797849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 188/396] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:17 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:18.124697 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:18.125307 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:18.131408 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:18.131852 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:18.132635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:18.133071 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:18.263586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:18.272009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:18.273786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:18.274933 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5610fe26-a09d-43f6-82d8-42a1dc9ed2cc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.154157 Aug 02 21:44:18.275475 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 209/397] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:18 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:18.804417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d59a1a30-20a7-426a-857e-99ac181a1077 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:18.805943 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d59a1a30-20a7-426a-857e-99ac181a1077 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:18.818253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d59a1a30-20a7-426a-857e-99ac181a1077 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:18.819081 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d59a1a30-20a7-426a-857e-99ac181a1077 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:18.819216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f1fa7623-27d3-439a-814e-c6634d9bac4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:18.819787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f1fa7623-27d3-439a-814e-c6634d9bac4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:18.820773 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d59a1a30-20a7-426a-857e-99ac181a1077 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:18.821428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d59a1a30-20a7-426a-857e-99ac181a1077 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:18.828580 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f1fa7623-27d3-439a-814e-c6634d9bac4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:18.829377 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f1fa7623-27d3-439a-814e-c6634d9bac4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:18.830461 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f1fa7623-27d3-439a-814e-c6634d9bac4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:18.831060 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f1fa7623-27d3-439a-814e-c6634d9bac4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:18.893925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d59a1a30-20a7-426a-857e-99ac181a1077 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:18.905970 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d59a1a30-20a7-426a-857e-99ac181a1077 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1136 microversion: 2.1 time: 0.107362 Aug 02 21:44:18.907150 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 189/398] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:18 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1136 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:18.984620 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f1fa7623-27d3-439a-814e-c6634d9bac4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:18.993042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f1fa7623-27d3-439a-814e-c6634d9bac4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.178577 Aug 02 21:44:18.993678 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 210/399] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:18 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:19.298744 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:19.299448 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:19.306090 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:19.306625 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:19.307469 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:19.307982 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:19.488050 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:19.496411 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:19.498063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:19.499487 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2c8f1006-f7e1-43a9-93d9-fd9bc14a9bb8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.204773 Aug 02 21:44:19.500057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 190/400] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:19 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:19.927116 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e300286d-67d0-4600-87b2-1676c5e52483 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:19.927730 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e300286d-67d0-4600-87b2-1676c5e52483 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:19.934141 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e300286d-67d0-4600-87b2-1676c5e52483 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:19.934589 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e300286d-67d0-4600-87b2-1676c5e52483 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:19.935354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e300286d-67d0-4600-87b2-1676c5e52483 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:19.935790 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e300286d-67d0-4600-87b2-1676c5e52483 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:20.015425 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fafda1fb-cad8-4b38-86d5-99a59a0b146d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:20.017025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fafda1fb-cad8-4b38-86d5-99a59a0b146d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:20.020676 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:20.026921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fafda1fb-cad8-4b38-86d5-99a59a0b146d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:20.027378 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fafda1fb-cad8-4b38-86d5-99a59a0b146d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:20.028210 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fafda1fb-cad8-4b38-86d5-99a59a0b146d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:20.028935 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fafda1fb-cad8-4b38-86d5-99a59a0b146d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:20.036732 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e300286d-67d0-4600-87b2-1676c5e52483 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:20.052380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e300286d-67d0-4600-87b2-1676c5e52483 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1136 microversion: 2.1 time: 0.129368 Aug 02 21:44:20.053334 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 211/401] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:19 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1136 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:20.073336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=10 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:20.236439 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fafda1fb-cad8-4b38-86d5-99a59a0b146d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:20.245324 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fafda1fb-cad8-4b38-86d5-99a59a0b146d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.235105 Aug 02 21:44:20.245886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 191/402] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:20 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:20.523288 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:20.523839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:20.529754 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:20.530208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:20.530978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:20.531584 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:20.736997 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:20.745488 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:20.746978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:20.748175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-cddd439c-8e59-4693-81f4-dc90f2d92607 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1743 microversion: 2.20 time: 0.229093 Aug 02 21:44:20.748701 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 212/403] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:20 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:21.084576 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2e113cfd-4f64-4d85-a4bd-85fd47c6642c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:21.085209 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2e113cfd-4f64-4d85-a4bd-85fd47c6642c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:21.095207 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2e113cfd-4f64-4d85-a4bd-85fd47c6642c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:21.096065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2e113cfd-4f64-4d85-a4bd-85fd47c6642c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:21.098265 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2e113cfd-4f64-4d85-a4bd-85fd47c6642c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:21.099057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2e113cfd-4f64-4d85-a4bd-85fd47c6642c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:21.168159 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2e113cfd-4f64-4d85-a4bd-85fd47c6642c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:21.175979 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2e113cfd-4f64-4d85-a4bd-85fd47c6642c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1192 microversion: 2.1 time: 0.102336 Aug 02 21:44:21.176906 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 192/404] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:21 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:21.266387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5a96dd78-7a54-4c48-bc9b-5e5e49fcf7ba tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:21.267095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5a96dd78-7a54-4c48-bc9b-5e5e49fcf7ba tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:21.274510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a96dd78-7a54-4c48-bc9b-5e5e49fcf7ba tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:21.275004 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a96dd78-7a54-4c48-bc9b-5e5e49fcf7ba tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:21.275815 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a96dd78-7a54-4c48-bc9b-5e5e49fcf7ba tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:21.276303 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a96dd78-7a54-4c48-bc9b-5e5e49fcf7ba tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:21.375780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-85b50d55-6b86-43f4-9d8a-8226456ca1de tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: .version_select at 0x7ff558008700>, body: {"keypair": {"name": "tempest-keypair-1689058455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLre1J1HxjevkNFY6SP7tAr3N0KywxSnKEK2tb9B73FJVjr5OPBpTku/ELJsEsvgUzMRTN608wQoopwguS69L++sok4ZfolOL1QoBwB30xhA7LLFtBGz2WKEzQlLNR80Ew=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:21.391225 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-85b50d55-6b86-43f4-9d8a-8226456ca1de tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for project c63bab062a6e4225a462ac0265535d16. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:44:21.395610 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-85b50d55-6b86-43f4-9d8a-8226456ca1de tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for user e477f5953a534355b29c071086846ff6 and project c63bab062a6e4225a462ac0265535d16. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:44:21.418708 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-85b50d55-6b86-43f4-9d8a-8226456ca1de tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046600 Aug 02 21:44:21.419306 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 193/405] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:44:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:44:21.468468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5a96dd78-7a54-4c48-bc9b-5e5e49fcf7ba tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:21.477170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5a96dd78-7a54-4c48-bc9b-5e5e49fcf7ba tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.214538 Aug 02 21:44:21.480987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 213/406] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:21 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:21.774037 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:21.774946 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:21.782347 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:21.783100 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:21.784100 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:21.785329 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:22.120723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:22.131682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:22.133314 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:22.134687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b075fd80-9c0c-43df-843d-db4c69048328 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1743 microversion: 2.20 time: 0.366796 Aug 02 21:44:22.135926 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 194/407] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:21 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1743 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:22.198970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f4e17d9a-8167-4099-ac51-82e0f41d9ef9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:22.200227 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f4e17d9a-8167-4099-ac51-82e0f41d9ef9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:22.212518 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4e17d9a-8167-4099-ac51-82e0f41d9ef9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:22.215652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4e17d9a-8167-4099-ac51-82e0f41d9ef9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:22.217532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4e17d9a-8167-4099-ac51-82e0f41d9ef9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:22.218834 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4e17d9a-8167-4099-ac51-82e0f41d9ef9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:22.319362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f4e17d9a-8167-4099-ac51-82e0f41d9ef9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:22.327978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f4e17d9a-8167-4099-ac51-82e0f41d9ef9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1210 microversion: 2.1 time: 0.134484 Aug 02 21:44:22.328858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 214/408] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:22 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:22.501628 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d8f28476-5f3d-4779-9a3e-aa4d00bb87da tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:22.503632 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d8f28476-5f3d-4779-9a3e-aa4d00bb87da tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:22.510336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8f28476-5f3d-4779-9a3e-aa4d00bb87da tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:22.510777 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8f28476-5f3d-4779-9a3e-aa4d00bb87da tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:22.511549 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8f28476-5f3d-4779-9a3e-aa4d00bb87da tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:22.511988 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8f28476-5f3d-4779-9a3e-aa4d00bb87da tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:22.752284 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d8f28476-5f3d-4779-9a3e-aa4d00bb87da tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:22.764432 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d8f28476-5f3d-4779-9a3e-aa4d00bb87da tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.266547 Aug 02 21:44:22.765545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 195/409] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:22 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:23.162048 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:23.162758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:23.170487 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:23.171033 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:23.172035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:23.172504 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:23.215265 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1633237408", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d6d25b-0453-4cac-840b-702ab041b963"}], "security_groups": [{"name": "tempest-securitygroup--1134433866"}], "key_name": "tempest-keypair-1689058455", "user_data": "}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:23.339432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:23.360836 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:23.363049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:23.364277 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-477e71b2-42bd-4229-a632-b3006dcafa4b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1743 microversion: 2.20 time: 0.209347 Aug 02 21:44:23.364851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 215/410] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:23 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1743 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:23.369576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-c0e38a1d-56e1-4017-b0bb-d938373c3768 req-1526892c-67e9-4601-ac66-3c69e3001ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "581dd5c7-3160-47ed-ac20-6d35cbd6604c", "name": "network-vif-plugged", "status": "completed", "tag": "1b078072-8634-47d5-b163-fe8eb6da769b"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:23.379511 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-c0e38a1d-56e1-4017-b0bb-d938373c3768 req-1526892c-67e9-4601-ac66-3c69e3001ee7 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:23.380367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-c0e38a1d-56e1-4017-b0bb-d938373c3768 req-1526892c-67e9-4601-ac66-3c69e3001ee7 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:23.395526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-c0e38a1d-56e1-4017-b0bb-d938373c3768 req-1526892c-67e9-4601-ac66-3c69e3001ee7 service nova] Creating event network-vif-plugged:1b078072-8634-47d5-b163-fe8eb6da769b for instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c on hv-cinder-85144 Aug 02 21:44:23.401670 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] validate_networks() for [('93d6d25b-0453-4cac-840b-702ab041b963', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:44:23.402498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-c0e38a1d-56e1-4017-b0bb-d938373c3768 req-1526892c-67e9-4601-ac66-3c69e3001ee7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036296 Aug 02 21:44:23.403381 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 216/411] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:23.411547 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4720ab03-2431-4c94-9966-66c0c6e9699e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:23.412293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4720ab03-2431-4c94-9966-66c0c6e9699e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:23.418763 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4720ab03-2431-4c94-9966-66c0c6e9699e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:23.419224 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4720ab03-2431-4c94-9966-66c0c6e9699e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:23.420016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4720ab03-2431-4c94-9966-66c0c6e9699e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:23.420511 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4720ab03-2431-4c94-9966-66c0c6e9699e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:23.436125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:23.570470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4720ab03-2431-4c94-9966-66c0c6e9699e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:23.578562 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4720ab03-2431-4c94-9966-66c0c6e9699e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.173847 Aug 02 21:44:23.579467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 217/412] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:23 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:23.639841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-46a1ff54-d1ec-4cdb-a7b7-c24a5b68e234 req-2c3c8e48-7a04-4f88-8344-e16eb9aac01b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0681fe-f330-40bb-ab1f-86772b3484e5", "tag": "c59fcd51-2b42-4947-8a95-8e2d432d140f"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:23.652579 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-46a1ff54-d1ec-4cdb-a7b7-c24a5b68e234 req-2c3c8e48-7a04-4f88-8344-e16eb9aac01b service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:23.653439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-46a1ff54-d1ec-4cdb-a7b7-c24a5b68e234 req-2c3c8e48-7a04-4f88-8344-e16eb9aac01b service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:23.666046 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-46a1ff54-d1ec-4cdb-a7b7-c24a5b68e234 req-2c3c8e48-7a04-4f88-8344-e16eb9aac01b service nova] Creating event network-changed:c59fcd51-2b42-4947-8a95-8e2d432d140f for instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 on hv-cinder-85144 Aug 02 21:44:23.671049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-46a1ff54-d1ec-4cdb-a7b7-c24a5b68e234 req-2c3c8e48-7a04-4f88-8344-e16eb9aac01b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034902 Aug 02 21:44:23.671637 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 218/413] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:44:23.789473 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ac2f25b9-e4be-4a5b-8f93-a087f007ac0c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:23.790426 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ac2f25b9-e4be-4a5b-8f93-a087f007ac0c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:23.811682 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ac2f25b9-e4be-4a5b-8f93-a087f007ac0c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:23.812380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ac2f25b9-e4be-4a5b-8f93-a087f007ac0c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:23.813327 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ac2f25b9-e4be-4a5b-8f93-a087f007ac0c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:23.813919 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ac2f25b9-e4be-4a5b-8f93-a087f007ac0c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:23.995832 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ac2f25b9-e4be-4a5b-8f93-a087f007ac0c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:24.003775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ac2f25b9-e4be-4a5b-8f93-a087f007ac0c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.219693 Aug 02 21:44:24.004373 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 219/414] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:23 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:24.127374 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:44:24.127983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:44:24.128792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:44:24.129262 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:44:24.129769 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:44:24.139086 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:24.139539 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:24.140384 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:24.140825 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:24.158196 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for project c63bab062a6e4225a462ac0265535d16. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:44:24.162547 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for user e477f5953a534355b29c071086846ff6 and project c63bab062a6e4225a462ac0265535d16. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:44:24.173747 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:44:24.176214 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:44:24.224192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-abb5255f-a9df-42d1-9856-774f90823405 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.013074 Aug 02 21:44:24.230893 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 196/415] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:44:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 21:44:24.236623 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8806a5be-d657-48c1-bba9-7d2ec056471b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:24.237606 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8806a5be-d657-48c1-bba9-7d2ec056471b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:24.295172 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8806a5be-d657-48c1-bba9-7d2ec056471b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:24.302207 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8806a5be-d657-48c1-bba9-7d2ec056471b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1242 microversion: 2.1 time: 0.069987 Aug 02 21:44:24.302763 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 220/416] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:24 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:24.386914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:24.387527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:24.395685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:24.396401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:24.397191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:24.397877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:24.601674 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c53d0f7b-e0df-4b69-ae52-2756b9ec8bac tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:24.602469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c53d0f7b-e0df-4b69-ae52-2756b9ec8bac tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:24.610317 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c53d0f7b-e0df-4b69-ae52-2756b9ec8bac tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:24.610840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c53d0f7b-e0df-4b69-ae52-2756b9ec8bac tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:24.612031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c53d0f7b-e0df-4b69-ae52-2756b9ec8bac tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:24.613073 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c53d0f7b-e0df-4b69-ae52-2756b9ec8bac tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:24.638273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:24.648038 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:24.650313 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:24.651721 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b676d787-da0e-4726-a527-c93ccf8d5931 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1743 microversion: 2.20 time: 0.268987 Aug 02 21:44:24.652934 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 197/417] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:24 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1743 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:24.765635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c53d0f7b-e0df-4b69-ae52-2756b9ec8bac tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:24.774896 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c53d0f7b-e0df-4b69-ae52-2756b9ec8bac tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.177796 Aug 02 21:44:24.775790 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 221/418] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:24 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:25.025683 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2499d278-252b-45a3-8931-d931d94486b5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:25.026419 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2499d278-252b-45a3-8931-d931d94486b5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:25.035124 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2499d278-252b-45a3-8931-d931d94486b5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:25.035578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2499d278-252b-45a3-8931-d931d94486b5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:25.036399 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2499d278-252b-45a3-8931-d931d94486b5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:25.036842 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2499d278-252b-45a3-8931-d931d94486b5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:25.181124 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2499d278-252b-45a3-8931-d931d94486b5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:25.188667 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2499d278-252b-45a3-8931-d931d94486b5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.168948 Aug 02 21:44:25.189189 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 198/419] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:25 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:25.323102 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ec29854f-6124-4e38-989b-107a2db193ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:25.323886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ec29854f-6124-4e38-989b-107a2db193ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:25.331338 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ec29854f-6124-4e38-989b-107a2db193ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:25.331791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ec29854f-6124-4e38-989b-107a2db193ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:25.332597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ec29854f-6124-4e38-989b-107a2db193ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:25.333036 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ec29854f-6124-4e38-989b-107a2db193ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:25.402813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ec29854f-6124-4e38-989b-107a2db193ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:25.411597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ec29854f-6124-4e38-989b-107a2db193ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1302 microversion: 2.1 time: 0.092237 Aug 02 21:44:25.421959 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 222/420] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:25 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:25.675504 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:25.676269 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:25.678557 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:25.684545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:25.685003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:25.685769 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:25.686210 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:25.796216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-070e1a3b-86e7-4423-a3ae-50deab2cea39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:25.799122 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-070e1a3b-86e7-4423-a3ae-50deab2cea39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:25.804306 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-070e1a3b-86e7-4423-a3ae-50deab2cea39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:25.804437 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-070e1a3b-86e7-4423-a3ae-50deab2cea39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:25.805167 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-070e1a3b-86e7-4423-a3ae-50deab2cea39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:25.805600 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-070e1a3b-86e7-4423-a3ae-50deab2cea39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:25.909016 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:25.918930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:25.920811 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:25.922413 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8f2fb8c3-8685-4e59-ba4f-6cd39cab4052 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1743 microversion: 2.20 time: 0.250937 Aug 02 21:44:25.923053 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 199/421] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:25 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:25.941768 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-070e1a3b-86e7-4423-a3ae-50deab2cea39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:25.949211 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-070e1a3b-86e7-4423-a3ae-50deab2cea39 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.156814 Aug 02 21:44:25.949786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 223/422] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:25 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:26.209441 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a144fdf7-5f31-4e84-ae21-7f854eb7f0cc tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:26.210186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a144fdf7-5f31-4e84-ae21-7f854eb7f0cc tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:26.216805 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a144fdf7-5f31-4e84-ae21-7f854eb7f0cc tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:26.217351 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a144fdf7-5f31-4e84-ae21-7f854eb7f0cc tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:26.218205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a144fdf7-5f31-4e84-ae21-7f854eb7f0cc tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:26.218703 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a144fdf7-5f31-4e84-ae21-7f854eb7f0cc tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:26.434607 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fd848066-be84-4e77-ace8-7e6f264a89b6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:26.435234 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-fd848066-be84-4e77-ace8-7e6f264a89b6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:26.442210 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fd848066-be84-4e77-ace8-7e6f264a89b6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:26.442695 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fd848066-be84-4e77-ace8-7e6f264a89b6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:26.443491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fd848066-be84-4e77-ace8-7e6f264a89b6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:26.444068 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fd848066-be84-4e77-ace8-7e6f264a89b6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:26.479025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a144fdf7-5f31-4e84-ae21-7f854eb7f0cc tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:26.487259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a144fdf7-5f31-4e84-ae21-7f854eb7f0cc tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.281554 Aug 02 21:44:26.492733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 200/423] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:26 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:26.633598 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-fd848066-be84-4e77-ace8-7e6f264a89b6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:26.641484 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-fd848066-be84-4e77-ace8-7e6f264a89b6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.210671 Aug 02 21:44:26.642062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 224/424] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:26 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:26.947433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:26.948108 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:26.954456 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:26.957561 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:26.958458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:26.958965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:26.971060 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-545e5723-c48a-4772-941f-e0a79ad94419 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:26.972321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-545e5723-c48a-4772-941f-e0a79ad94419 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:26.980819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-545e5723-c48a-4772-941f-e0a79ad94419 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:26.981627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-545e5723-c48a-4772-941f-e0a79ad94419 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:26.982887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-545e5723-c48a-4772-941f-e0a79ad94419 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:26.983589 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-545e5723-c48a-4772-941f-e0a79ad94419 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:27.136815 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-545e5723-c48a-4772-941f-e0a79ad94419 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:27.145159 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-545e5723-c48a-4772-941f-e0a79ad94419 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.178470 Aug 02 21:44:27.145737 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 225/425] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:26 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:27.180401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:27.198049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:27.199618 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:27.201274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8fdf9202-3107-4956-8fd2-0ebdfd72290b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1743 microversion: 2.20 time: 0.258033 Aug 02 21:44:27.201833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 201/426] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:26 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:27.214089 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-72472665-2674-4dbf-94fa-ceb37a3c9aee req-e7b3a216-a047-4509-b566-5bec27e0734d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a43570-a3a3-44b3-80c6-dc192cc97025", "tag": "ca6af77c-db43-4a8d-9e66-2f05cfd88f76"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:27.224644 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-72472665-2674-4dbf-94fa-ceb37a3c9aee req-e7b3a216-a047-4509-b566-5bec27e0734d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:27.225097 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-72472665-2674-4dbf-94fa-ceb37a3c9aee req-e7b3a216-a047-4509-b566-5bec27e0734d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:27.236732 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-72472665-2674-4dbf-94fa-ceb37a3c9aee req-e7b3a216-a047-4509-b566-5bec27e0734d service nova] Creating event network-changed:ca6af77c-db43-4a8d-9e66-2f05cfd88f76 for instance f3a43570-a3a3-44b3-80c6-dc192cc97025 on hv-cinder-85144 Aug 02 21:44:27.242456 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-72472665-2674-4dbf-94fa-ceb37a3c9aee req-e7b3a216-a047-4509-b566-5bec27e0734d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032573 Aug 02 21:44:27.243270 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 226/427] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:27.513222 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1fdc7875-0a56-41dd-8b7c-2aa0711e69c5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:27.513842 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1fdc7875-0a56-41dd-8b7c-2aa0711e69c5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:27.520071 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1fdc7875-0a56-41dd-8b7c-2aa0711e69c5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:27.520558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1fdc7875-0a56-41dd-8b7c-2aa0711e69c5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:27.521336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1fdc7875-0a56-41dd-8b7c-2aa0711e69c5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:27.521779 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1fdc7875-0a56-41dd-8b7c-2aa0711e69c5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:27.654875 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1fdc7875-0a56-41dd-8b7c-2aa0711e69c5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:27.664088 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1fdc7875-0a56-41dd-8b7c-2aa0711e69c5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.154649 Aug 02 21:44:27.664366 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7319acd1-1493-4260-b00f-dc4888768fe6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:27.665076 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 202/428] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:27 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:27.665186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7319acd1-1493-4260-b00f-dc4888768fe6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:27.672124 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7319acd1-1493-4260-b00f-dc4888768fe6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:27.672627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7319acd1-1493-4260-b00f-dc4888768fe6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:27.673557 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7319acd1-1493-4260-b00f-dc4888768fe6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:27.674012 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7319acd1-1493-4260-b00f-dc4888768fe6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:27.834039 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7319acd1-1493-4260-b00f-dc4888768fe6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:27.841485 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7319acd1-1493-4260-b00f-dc4888768fe6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.182453 Aug 02 21:44:27.842049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 227/429] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:27 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:28.166179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6479fbdd-f6f0-4108-a7b6-81a04e8d988e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:28.166792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6479fbdd-f6f0-4108-a7b6-81a04e8d988e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:28.174206 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6479fbdd-f6f0-4108-a7b6-81a04e8d988e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:28.174914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6479fbdd-f6f0-4108-a7b6-81a04e8d988e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:28.176013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6479fbdd-f6f0-4108-a7b6-81a04e8d988e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:28.176610 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6479fbdd-f6f0-4108-a7b6-81a04e8d988e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:28.223522 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:28.224118 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:28.230282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:28.230740 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:28.231520 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:28.231962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:28.319883 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6479fbdd-f6f0-4108-a7b6-81a04e8d988e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:28.327987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6479fbdd-f6f0-4108-a7b6-81a04e8d988e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.165613 Aug 02 21:44:28.328946 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 203/430] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:28 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:28.380486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:28.388568 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:28.390138 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:28.391376 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-49f38cb4-0b63-4913-96c4-da0e43cac938 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.172443 Aug 02 21:44:28.392038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 228/431] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:28 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:28.687316 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-20fe1d67-d895-498f-abf6-4c910a0485b4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:28.688376 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-20fe1d67-d895-498f-abf6-4c910a0485b4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:28.697876 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-20fe1d67-d895-498f-abf6-4c910a0485b4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:28.699359 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-20fe1d67-d895-498f-abf6-4c910a0485b4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:28.700475 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-20fe1d67-d895-498f-abf6-4c910a0485b4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:28.706849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-20fe1d67-d895-498f-abf6-4c910a0485b4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:28.863362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d57b73b3-2403-4db9-8c4c-ae2b943f7fd9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:28.864326 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d57b73b3-2403-4db9-8c4c-ae2b943f7fd9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:28.871615 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d57b73b3-2403-4db9-8c4c-ae2b943f7fd9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:28.872075 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d57b73b3-2403-4db9-8c4c-ae2b943f7fd9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:28.879368 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d57b73b3-2403-4db9-8c4c-ae2b943f7fd9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:28.880093 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d57b73b3-2403-4db9-8c4c-ae2b943f7fd9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:28.895865 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-20fe1d67-d895-498f-abf6-4c910a0485b4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:28.903867 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-20fe1d67-d895-498f-abf6-4c910a0485b4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.222086 Aug 02 21:44:28.909290 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 204/432] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:28 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:29.054458 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d57b73b3-2403-4db9-8c4c-ae2b943f7fd9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:29.062919 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d57b73b3-2403-4db9-8c4c-ae2b943f7fd9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.204375 Aug 02 21:44:29.063500 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 229/433] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:28 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:29.332292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-de1d215d-c898-4785-9ef2-8bb7d9d850a4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:29.338953 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-de1d215d-c898-4785-9ef2-8bb7d9d850a4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.339293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-de1d215d-c898-4785-9ef2-8bb7d9d850a4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:29.351032 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e02962b3-d8b1-4916-9de1-6e0924f5826b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:29.352257 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e02962b3-d8b1-4916-9de1-6e0924f5826b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:29.360222 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e02962b3-d8b1-4916-9de1-6e0924f5826b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.368943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e02962b3-d8b1-4916-9de1-6e0924f5826b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:29.369720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e02962b3-d8b1-4916-9de1-6e0924f5826b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.370254 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e02962b3-d8b1-4916-9de1-6e0924f5826b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:29.442324 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-de1d215d-c898-4785-9ef2-8bb7d9d850a4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Going to try to stop instance {{(pid=124840) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 21:44:29.446057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=100 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:29.498506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-de1d215d-c898-4785-9ef2-8bb7d9d850a4 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/action" status: 202 len: 0 microversion: 2.1 time: 0.170161 Aug 02 21:44:29.503854 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 205/434] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:44:29 2022] POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:44:29.523047 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:29.529731 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:29.545214 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.546239 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:29.547447 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.548118 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:29.617215 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e02962b3-d8b1-4916-9de1-6e0924f5826b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:29.630786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e02962b3-d8b1-4916-9de1-6e0924f5826b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.284694 Aug 02 21:44:29.651853 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 230/435] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:29 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:29.671100 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4fabff9b-1ea7-4abe-9e0a-edc14a9814e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:29.671733 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4fabff9b-1ea7-4abe-9e0a-edc14a9814e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:29.687493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4fabff9b-1ea7-4abe-9e0a-edc14a9814e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.687957 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4fabff9b-1ea7-4abe-9e0a-edc14a9814e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:29.688774 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4fabff9b-1ea7-4abe-9e0a-edc14a9814e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.689221 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4fabff9b-1ea7-4abe-9e0a-edc14a9814e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:29.754874 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:29.781030 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:29.791602 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:29.793373 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ccf4d5c1-ff3b-4e61-8e78-0e1fab4c4d0f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.288046 Aug 02 21:44:29.798741 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 206/436] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:29 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:29.866663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4fabff9b-1ea7-4abe-9e0a-edc14a9814e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:29.875018 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4fabff9b-1ea7-4abe-9e0a-edc14a9814e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.209244 Aug 02 21:44:29.875941 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 231/437] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:29 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:29.937186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2ffa7324-2fd7-47b7-8ce6-4417ad260867 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:29.937797 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2ffa7324-2fd7-47b7-8ce6-4417ad260867 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:29.944477 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ffa7324-2fd7-47b7-8ce6-4417ad260867 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.945135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ffa7324-2fd7-47b7-8ce6-4417ad260867 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:29.952388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ffa7324-2fd7-47b7-8ce6-4417ad260867 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:29.953082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ffa7324-2fd7-47b7-8ce6-4417ad260867 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:30.084346 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-845b6693-680f-4eea-ab80-bb0e4fdf4e09 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:30.084958 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-845b6693-680f-4eea-ab80-bb0e4fdf4e09 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:30.097202 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-845b6693-680f-4eea-ab80-bb0e4fdf4e09 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:30.097945 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-845b6693-680f-4eea-ab80-bb0e4fdf4e09 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:30.098732 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-845b6693-680f-4eea-ab80-bb0e4fdf4e09 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:30.099168 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-845b6693-680f-4eea-ab80-bb0e4fdf4e09 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:30.120690 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2ffa7324-2fd7-47b7-8ce6-4417ad260867 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:30.128874 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2ffa7324-2fd7-47b7-8ce6-4417ad260867 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.195464 Aug 02 21:44:30.130734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 207/438] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:29 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:30.275826 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-845b6693-680f-4eea-ab80-bb0e4fdf4e09 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:30.285777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-845b6693-680f-4eea-ab80-bb0e4fdf4e09 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.206603 Aug 02 21:44:30.286608 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 232/439] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:30 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:30.652922 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-75df3ff5-7fa5-4e19-a46d-76396a58f8ed tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:30.654529 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-75df3ff5-7fa5-4e19-a46d-76396a58f8ed tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:30.661403 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-75df3ff5-7fa5-4e19-a46d-76396a58f8ed tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:30.662122 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-75df3ff5-7fa5-4e19-a46d-76396a58f8ed tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:30.663089 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-75df3ff5-7fa5-4e19-a46d-76396a58f8ed tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:30.663708 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-75df3ff5-7fa5-4e19-a46d-76396a58f8ed tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:30.819523 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-75df3ff5-7fa5-4e19-a46d-76396a58f8ed tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:30.824438 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:30.825656 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:30.827936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-75df3ff5-7fa5-4e19-a46d-76396a58f8ed tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.178820 Aug 02 21:44:30.840180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:30.840180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:30.840180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:30.840180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:30.841137 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 208/440] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:30 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:30.899146 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d7249b9f-8828-44b6-8827-0d8749107b9d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:30.899983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d7249b9f-8828-44b6-8827-0d8749107b9d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:30.907999 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d7249b9f-8828-44b6-8827-0d8749107b9d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:30.908407 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d7249b9f-8828-44b6-8827-0d8749107b9d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:30.909252 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d7249b9f-8828-44b6-8827-0d8749107b9d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:30.909697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d7249b9f-8828-44b6-8827-0d8749107b9d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:31.049092 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:31.062669 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:31.067348 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:31.068863 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9d46482d-acaf-45f0-9163-bcd06f81ffdd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.248199 Aug 02 21:44:31.069899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 233/441] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:30 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:31.122247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d7249b9f-8828-44b6-8827-0d8749107b9d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:31.132185 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d7249b9f-8828-44b6-8827-0d8749107b9d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.239313 Aug 02 21:44:31.133366 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 209/442] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:30 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:31.150872 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-13ef8641-b213-4ee1-940e-4560f0cbf92a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:31.152590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-13ef8641-b213-4ee1-940e-4560f0cbf92a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:31.161599 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13ef8641-b213-4ee1-940e-4560f0cbf92a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:31.162138 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13ef8641-b213-4ee1-940e-4560f0cbf92a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:31.163027 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13ef8641-b213-4ee1-940e-4560f0cbf92a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:31.163558 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13ef8641-b213-4ee1-940e-4560f0cbf92a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:31.312642 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-368514c7-6f7d-4404-8789-2090c34c1bca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:31.313524 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-368514c7-6f7d-4404-8789-2090c34c1bca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:31.322054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-368514c7-6f7d-4404-8789-2090c34c1bca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:31.322542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-368514c7-6f7d-4404-8789-2090c34c1bca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:31.323415 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-368514c7-6f7d-4404-8789-2090c34c1bca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:31.323855 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-368514c7-6f7d-4404-8789-2090c34c1bca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:31.345395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-13ef8641-b213-4ee1-940e-4560f0cbf92a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:31.356913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-13ef8641-b213-4ee1-940e-4560f0cbf92a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1270 microversion: 2.1 time: 0.209399 Aug 02 21:44:31.358197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 234/443] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:31 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:31.512697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-368514c7-6f7d-4404-8789-2090c34c1bca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:31.522406 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-368514c7-6f7d-4404-8789-2090c34c1bca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.213784 Aug 02 21:44:31.523541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 210/444] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:31 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:31.850634 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f96f57cd-0f26-4d4d-9a9c-461042836945 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:31.851284 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f96f57cd-0f26-4d4d-9a9c-461042836945 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:31.857874 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f96f57cd-0f26-4d4d-9a9c-461042836945 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:31.858330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f96f57cd-0f26-4d4d-9a9c-461042836945 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:31.859107 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f96f57cd-0f26-4d4d-9a9c-461042836945 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:31.859548 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f96f57cd-0f26-4d4d-9a9c-461042836945 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.036125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f96f57cd-0f26-4d4d-9a9c-461042836945 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:32.048269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f96f57cd-0f26-4d4d-9a9c-461042836945 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.201278 Aug 02 21:44:32.049115 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 235/445] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:31 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:32.091254 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:32.091886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:32.102499 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:32.103291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.104428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:32.105113 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.155784 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-818b9d75-377e-475f-9511-5e9086f3cd2c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:32.156479 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-818b9d75-377e-475f-9511-5e9086f3cd2c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:32.163979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-818b9d75-377e-475f-9511-5e9086f3cd2c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:32.164699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-818b9d75-377e-475f-9511-5e9086f3cd2c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.165808 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-818b9d75-377e-475f-9511-5e9086f3cd2c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:32.166628 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-818b9d75-377e-475f-9511-5e9086f3cd2c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.197493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:32.359855 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:32.367671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-818b9d75-377e-475f-9511-5e9086f3cd2c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:32.373007 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:32.375127 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:32.376942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0509cfc2-fbf8-42fb-a02f-874e62a5872e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.289545 Aug 02 21:44:32.378911 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-818b9d75-377e-475f-9511-5e9086f3cd2c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.227202 Aug 02 21:44:32.379329 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 211/446] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:32 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:32.380218 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 236/447] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:32 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:32.384175 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-64b68be0-5049-46bf-8049-49e256ae6ad0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:32.384786 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-64b68be0-5049-46bf-8049-49e256ae6ad0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:32.391112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-64b68be0-5049-46bf-8049-49e256ae6ad0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:32.391794 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-64b68be0-5049-46bf-8049-49e256ae6ad0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.392782 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-64b68be0-5049-46bf-8049-49e256ae6ad0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:32.393855 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-64b68be0-5049-46bf-8049-49e256ae6ad0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.547783 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0642af07-edd4-4a70-bb5c-2d7c21d6f256 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:32.548439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0642af07-edd4-4a70-bb5c-2d7c21d6f256 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:32.550982 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-64b68be0-5049-46bf-8049-49e256ae6ad0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:32.562171 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0642af07-edd4-4a70-bb5c-2d7c21d6f256 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:32.562694 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0642af07-edd4-4a70-bb5c-2d7c21d6f256 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.564178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0642af07-edd4-4a70-bb5c-2d7c21d6f256 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:32.564634 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0642af07-edd4-4a70-bb5c-2d7c21d6f256 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:32.574177 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-64b68be0-5049-46bf-8049-49e256ae6ad0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.193601 Aug 02 21:44:32.579003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 212/448] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:32 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:33.008797 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0642af07-edd4-4a70-bb5c-2d7c21d6f256 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:33.022259 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0642af07-edd4-4a70-bb5c-2d7c21d6f256 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.482358 Aug 02 21:44:33.023100 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 237/449] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:32 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:33.077964 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4cc1c134-fcca-43c6-a49a-685022064e37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:33.078482 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4cc1c134-fcca-43c6-a49a-685022064e37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:33.087801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4cc1c134-fcca-43c6-a49a-685022064e37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:33.087801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4cc1c134-fcca-43c6-a49a-685022064e37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:33.087801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4cc1c134-fcca-43c6-a49a-685022064e37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:33.087801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4cc1c134-fcca-43c6-a49a-685022064e37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:33.416459 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8001ce4b-5fc6-46f8-bb1f-2099ac571bc3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:33.417095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8001ce4b-5fc6-46f8-bb1f-2099ac571bc3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:33.428767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8001ce4b-5fc6-46f8-bb1f-2099ac571bc3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:33.429929 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8001ce4b-5fc6-46f8-bb1f-2099ac571bc3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:33.430920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8001ce4b-5fc6-46f8-bb1f-2099ac571bc3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:33.431760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8001ce4b-5fc6-46f8-bb1f-2099ac571bc3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:33.446582 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4cc1c134-fcca-43c6-a49a-685022064e37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:33.459420 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4cc1c134-fcca-43c6-a49a-685022064e37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1277 microversion: 2.1 time: 0.386147 Aug 02 21:44:33.460186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 213/450] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:33 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1277 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:33.481601 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:33.488922 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:33.509019 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:33.509858 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:33.514984 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:33.515687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:33.680854 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8001ce4b-5fc6-46f8-bb1f-2099ac571bc3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:33.701490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8001ce4b-5fc6-46f8-bb1f-2099ac571bc3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.289634 Aug 02 21:44:33.702356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 238/451] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:33 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:33.711901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-78f0e6d6-a5cf-4421-83eb-16ac920bf9c7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:33.713444 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-78f0e6d6-a5cf-4421-83eb-16ac920bf9c7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:33.727095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-78f0e6d6-a5cf-4421-83eb-16ac920bf9c7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:33.727947 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-78f0e6d6-a5cf-4421-83eb-16ac920bf9c7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:33.729794 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-78f0e6d6-a5cf-4421-83eb-16ac920bf9c7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:33.730389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-78f0e6d6-a5cf-4421-83eb-16ac920bf9c7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:33.816013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:33.831195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:33.835133 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:33.836626 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3936db71-4fa1-4af5-ad1d-7e6634b4bff3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.375084 Aug 02 21:44:33.840189 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 214/452] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:33 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:33.957464 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-78f0e6d6-a5cf-4421-83eb-16ac920bf9c7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:33.970972 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-78f0e6d6-a5cf-4421-83eb-16ac920bf9c7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.267057 Aug 02 21:44:33.974844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 239/453] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:33 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:34.043595 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0cd1c7fa-4fbd-4f25-9d38-8d635b2b6dac tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:34.044326 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0cd1c7fa-4fbd-4f25-9d38-8d635b2b6dac tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:34.054188 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0cd1c7fa-4fbd-4f25-9d38-8d635b2b6dac tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:34.054647 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0cd1c7fa-4fbd-4f25-9d38-8d635b2b6dac tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:34.055598 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0cd1c7fa-4fbd-4f25-9d38-8d635b2b6dac tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:34.056039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0cd1c7fa-4fbd-4f25-9d38-8d635b2b6dac tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:34.149950 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:34.169713 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=10 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:34.213456 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0cd1c7fa-4fbd-4f25-9d38-8d635b2b6dac tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:34.224936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0cd1c7fa-4fbd-4f25-9d38-8d635b2b6dac tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.185498 Aug 02 21:44:34.239104 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 215/454] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:34 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:34.486421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8c32a30e-7923-4d31-8d8e-a97821a591b8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:34.487775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8c32a30e-7923-4d31-8d8e-a97821a591b8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:34.489776 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:34.496870 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8c32a30e-7923-4d31-8d8e-a97821a591b8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:34.497685 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8c32a30e-7923-4d31-8d8e-a97821a591b8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:34.498731 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8c32a30e-7923-4d31-8d8e-a97821a591b8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:34.499248 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8c32a30e-7923-4d31-8d8e-a97821a591b8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:34.664281 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8c32a30e-7923-4d31-8d8e-a97821a591b8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:34.672103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8c32a30e-7923-4d31-8d8e-a97821a591b8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.190133 Aug 02 21:44:34.685795 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 240/455] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:34 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:34.726567 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0a65de9a-d752-4a61-9214-adf366224fbc tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:34.727871 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0a65de9a-d752-4a61-9214-adf366224fbc tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:34.734219 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0a65de9a-d752-4a61-9214-adf366224fbc tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:34.734937 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0a65de9a-d752-4a61-9214-adf366224fbc tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:34.736059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0a65de9a-d752-4a61-9214-adf366224fbc tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:34.736786 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0a65de9a-d752-4a61-9214-adf366224fbc tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:34.860113 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:34.860763 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:34.870610 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:34.873779 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:34.874792 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:34.874931 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0a65de9a-d752-4a61-9214-adf366224fbc tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:34.875548 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:34.883492 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0a65de9a-d752-4a61-9214-adf366224fbc tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.160936 Aug 02 21:44:34.896161 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 216/456] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:34 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:34.995624 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f14c7d88-28da-4a33-9e91-934139792f61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:34.996176 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f14c7d88-28da-4a33-9e91-934139792f61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:35.003491 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f14c7d88-28da-4a33-9e91-934139792f61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:35.003966 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f14c7d88-28da-4a33-9e91-934139792f61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:35.004952 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f14c7d88-28da-4a33-9e91-934139792f61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:35.005249 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f14c7d88-28da-4a33-9e91-934139792f61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:35.048463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:35.063438 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:35.065375 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:35.066563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b6ab2470-40ca-4801-b973-1f2aff0f1d25 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.210334 Aug 02 21:44:35.067299 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 241/457] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:34 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:35.249288 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-660e6e7f-1d96-4a41-8987-5be9afd07035 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:35.250362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-660e6e7f-1d96-4a41-8987-5be9afd07035 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:35.259016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-660e6e7f-1d96-4a41-8987-5be9afd07035 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:35.259456 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-660e6e7f-1d96-4a41-8987-5be9afd07035 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:35.260428 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-660e6e7f-1d96-4a41-8987-5be9afd07035 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:35.260871 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-660e6e7f-1d96-4a41-8987-5be9afd07035 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:35.277730 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f14c7d88-28da-4a33-9e91-934139792f61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:35.289605 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f14c7d88-28da-4a33-9e91-934139792f61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.299252 Aug 02 21:44:35.290227 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 217/458] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:34 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:35.414187 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-660e6e7f-1d96-4a41-8987-5be9afd07035 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:35.422187 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-660e6e7f-1d96-4a41-8987-5be9afd07035 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.178814 Aug 02 21:44:35.422903 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 242/459] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:35 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:35.695138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-60893f52-9efd-4916-bca3-a50df6c5825b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:35.696616 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-60893f52-9efd-4916-bca3-a50df6c5825b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:35.707619 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-60893f52-9efd-4916-bca3-a50df6c5825b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:35.708850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-60893f52-9efd-4916-bca3-a50df6c5825b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:35.710314 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-60893f52-9efd-4916-bca3-a50df6c5825b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:35.710974 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-60893f52-9efd-4916-bca3-a50df6c5825b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:35.906117 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c7b7b6c8-0229-4b96-ab26-3e2cb22e0f16 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:35.906937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c7b7b6c8-0229-4b96-ab26-3e2cb22e0f16 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:35.907717 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-60893f52-9efd-4916-bca3-a50df6c5825b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:35.919443 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c7b7b6c8-0229-4b96-ab26-3e2cb22e0f16 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:35.920267 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c7b7b6c8-0229-4b96-ab26-3e2cb22e0f16 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:35.920714 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c7b7b6c8-0229-4b96-ab26-3e2cb22e0f16 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:35.921153 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c7b7b6c8-0229-4b96-ab26-3e2cb22e0f16 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:35.927869 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-60893f52-9efd-4916-bca3-a50df6c5825b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.238528 Aug 02 21:44:35.940157 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 218/460] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:35 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:36.024695 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-b9874b7a-3011-46d8-a17d-68d11defdb9d req-98dca7b0-e27a-4fa0-ac5b-347b89664d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a43570-a3a3-44b3-80c6-dc192cc97025", "name": "network-vif-plugged", "status": "completed", "tag": "ca6af77c-db43-4a8d-9e66-2f05cfd88f76"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:36.041396 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-b9874b7a-3011-46d8-a17d-68d11defdb9d req-98dca7b0-e27a-4fa0-ac5b-347b89664d98 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.042250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-b9874b7a-3011-46d8-a17d-68d11defdb9d req-98dca7b0-e27a-4fa0-ac5b-347b89664d98 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:36.055947 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-b9874b7a-3011-46d8-a17d-68d11defdb9d req-98dca7b0-e27a-4fa0-ac5b-347b89664d98 service nova] Creating event network-vif-plugged:ca6af77c-db43-4a8d-9e66-2f05cfd88f76 for instance f3a43570-a3a3-44b3-80c6-dc192cc97025 on hv-cinder-85144 Aug 02 21:44:36.061579 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-b9874b7a-3011-46d8-a17d-68d11defdb9d req-98dca7b0-e27a-4fa0-ac5b-347b89664d98 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041158 Aug 02 21:44:36.062172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 219/461] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:44:36.094069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:36.095290 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:36.104011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.104997 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:36.106058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.106720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:36.118758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c7b7b6c8-0229-4b96-ab26-3e2cb22e0f16 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:36.130172 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c7b7b6c8-0229-4b96-ab26-3e2cb22e0f16 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.225912 Aug 02 21:44:36.133120 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 243/462] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:35 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:36.291947 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:36.301533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:36.303523 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:36.304831 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1c77804b-c654-4bcf-bb6f-27bd45021b53 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.215762 Aug 02 21:44:36.305796 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 220/463] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:36 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:36.319776 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-90bb91be-93b6-4eab-9e69-71a9102e7afa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:36.320833 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-90bb91be-93b6-4eab-9e69-71a9102e7afa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:36.327610 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-90bb91be-93b6-4eab-9e69-71a9102e7afa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.328070 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-90bb91be-93b6-4eab-9e69-71a9102e7afa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:36.328893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-90bb91be-93b6-4eab-9e69-71a9102e7afa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.329341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-90bb91be-93b6-4eab-9e69-71a9102e7afa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:36.444170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1abeb6eb-8e68-4d0c-82e6-471f0ebd04c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:36.444851 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1abeb6eb-8e68-4d0c-82e6-471f0ebd04c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:36.451253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1abeb6eb-8e68-4d0c-82e6-471f0ebd04c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.452045 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1abeb6eb-8e68-4d0c-82e6-471f0ebd04c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:36.453091 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1abeb6eb-8e68-4d0c-82e6-471f0ebd04c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.453746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1abeb6eb-8e68-4d0c-82e6-471f0ebd04c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:36.483416 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-90bb91be-93b6-4eab-9e69-71a9102e7afa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:36.494357 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-90bb91be-93b6-4eab-9e69-71a9102e7afa tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.180386 Aug 02 21:44:36.495409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 244/464] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:36 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:36.591963 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1abeb6eb-8e68-4d0c-82e6-471f0ebd04c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:36.601228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1abeb6eb-8e68-4d0c-82e6-471f0ebd04c9 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.161695 Aug 02 21:44:36.613184 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 221/465] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:36 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:36.951031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c4e12336-c427-4f36-869d-cdb4b262d499 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:36.951651 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c4e12336-c427-4f36-869d-cdb4b262d499 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:36.958442 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4e12336-c427-4f36-869d-cdb4b262d499 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.959103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4e12336-c427-4f36-869d-cdb4b262d499 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:36.959753 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4e12336-c427-4f36-869d-cdb4b262d499 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:36.960226 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4e12336-c427-4f36-869d-cdb4b262d499 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.116320 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c4e12336-c427-4f36-869d-cdb4b262d499 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:37.124462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c4e12336-c427-4f36-869d-cdb4b262d499 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.177298 Aug 02 21:44:37.125032 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 245/466] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:36 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:37.157029 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ea948a50-610d-499b-89c2-f09b484f6330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:37.157649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ea948a50-610d-499b-89c2-f09b484f6330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:37.165244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea948a50-610d-499b-89c2-f09b484f6330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:37.165958 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea948a50-610d-499b-89c2-f09b484f6330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.167027 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea948a50-610d-499b-89c2-f09b484f6330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:37.167512 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea948a50-610d-499b-89c2-f09b484f6330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.170366 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:37.320430 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ea948a50-610d-499b-89c2-f09b484f6330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:37.332085 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ea948a50-610d-499b-89c2-f09b484f6330 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.176978 Aug 02 21:44:37.332314 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:37.333004 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:37.339521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:37.340257 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.341333 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:37.342117 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.347159 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 222/467] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:37 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:37.493009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:37.508909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:37.515205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-633f8cd3-3978-447d-a461-bb55e1bd5874 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:37.515948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-633f8cd3-3978-447d-a461-bb55e1bd5874 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:37.523231 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-633f8cd3-3978-447d-a461-bb55e1bd5874 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:37.524833 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:37.526319 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-770dc9cd-57e2-4eca-891a-842efc67d7b5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.199501 Aug 02 21:44:37.527159 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 246/468] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:37 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:37.540768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-633f8cd3-3978-447d-a461-bb55e1bd5874 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.541736 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-633f8cd3-3978-447d-a461-bb55e1bd5874 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:37.542268 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-633f8cd3-3978-447d-a461-bb55e1bd5874 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.625056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4e5035b4-8626-4394-a4c7-17a3c1f8a2f8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:37.625716 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4e5035b4-8626-4394-a4c7-17a3c1f8a2f8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:37.637768 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e5035b4-8626-4394-a4c7-17a3c1f8a2f8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:37.638228 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e5035b4-8626-4394-a4c7-17a3c1f8a2f8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.639073 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e5035b4-8626-4394-a4c7-17a3c1f8a2f8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:37.639517 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e5035b4-8626-4394-a4c7-17a3c1f8a2f8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:37.702888 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-633f8cd3-3978-447d-a461-bb55e1bd5874 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:37.711678 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-633f8cd3-3978-447d-a461-bb55e1bd5874 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.200481 Aug 02 21:44:37.712672 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 223/469] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:37 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:37.807799 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4e5035b4-8626-4394-a4c7-17a3c1f8a2f8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:37.816500 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4e5035b4-8626-4394-a4c7-17a3c1f8a2f8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1368 microversion: 2.1 time: 0.196219 Aug 02 21:44:37.817253 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 247/470] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:37 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:38.146929 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7b9b518b-f9eb-4313-9f66-48a2aa12b484 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:38.147977 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7b9b518b-f9eb-4313-9f66-48a2aa12b484 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:38.154592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b9b518b-f9eb-4313-9f66-48a2aa12b484 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.155534 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b9b518b-f9eb-4313-9f66-48a2aa12b484 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.156425 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b9b518b-f9eb-4313-9f66-48a2aa12b484 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.156875 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7b9b518b-f9eb-4313-9f66-48a2aa12b484 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.331407 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7b9b518b-f9eb-4313-9f66-48a2aa12b484 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:38.339551 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7b9b518b-f9eb-4313-9f66-48a2aa12b484 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.196459 Aug 02 21:44:38.340404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 224/471] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:38 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:38.355998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-241b9f1c-9571-4344-b6fb-22489c3d893e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:38.357204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-241b9f1c-9571-4344-b6fb-22489c3d893e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:38.367035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-241b9f1c-9571-4344-b6fb-22489c3d893e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.367490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-241b9f1c-9571-4344-b6fb-22489c3d893e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.368383 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-241b9f1c-9571-4344-b6fb-22489c3d893e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.368825 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-241b9f1c-9571-4344-b6fb-22489c3d893e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.512282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-241b9f1c-9571-4344-b6fb-22489c3d893e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:38.521162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-241b9f1c-9571-4344-b6fb-22489c3d893e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.171279 Aug 02 21:44:38.532218 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 248/472] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:38 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:38.552024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:38.552935 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:38.559541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.559998 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.560805 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.561242 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.702195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:38.710312 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:38.711828 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:38.713189 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f1fea240-3e2c-4fe7-8cb7-c4591e8fc1b3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.166255 Aug 02 21:44:38.713744 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 225/473] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:38 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:38.732982 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-bc1723cc-2b5f-4f39-806f-5b025def8e56 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:38.733975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-bc1723cc-2b5f-4f39-806f-5b025def8e56 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:38.740872 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bc1723cc-2b5f-4f39-806f-5b025def8e56 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.741332 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bc1723cc-2b5f-4f39-806f-5b025def8e56 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.742119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bc1723cc-2b5f-4f39-806f-5b025def8e56 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.742564 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bc1723cc-2b5f-4f39-806f-5b025def8e56 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.839240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-789fd123-32ba-4a86-8e94-dd1dcc210aef tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:38.840169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-789fd123-32ba-4a86-8e94-dd1dcc210aef tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:38.852602 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-789fd123-32ba-4a86-8e94-dd1dcc210aef tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.853400 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-789fd123-32ba-4a86-8e94-dd1dcc210aef tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.854597 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-789fd123-32ba-4a86-8e94-dd1dcc210aef tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:38.855241 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-789fd123-32ba-4a86-8e94-dd1dcc210aef tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:38.918417 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-bc1723cc-2b5f-4f39-806f-5b025def8e56 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:38.933021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-bc1723cc-2b5f-4f39-806f-5b025def8e56 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.204020 Aug 02 21:44:38.934021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 249/474] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:38 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:39.038186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-789fd123-32ba-4a86-8e94-dd1dcc210aef tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:39.047141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-789fd123-32ba-4a86-8e94-dd1dcc210aef tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1558 microversion: 2.1 time: 0.213381 Aug 02 21:44:39.047975 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 226/475] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:38 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:39.067728 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6915b067-9e76-4c24-b4c4-ee8f57a5823b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:39.068583 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6915b067-9e76-4c24-b4c4-ee8f57a5823b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:39.076816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6915b067-9e76-4c24-b4c4-ee8f57a5823b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.077282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6915b067-9e76-4c24-b4c4-ee8f57a5823b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.078099 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6915b067-9e76-4c24-b4c4-ee8f57a5823b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.078534 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6915b067-9e76-4c24-b4c4-ee8f57a5823b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.161540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6915b067-9e76-4c24-b4c4-ee8f57a5823b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097668 Aug 02 21:44:39.162130 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 250/476] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 2 21:44:39 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:39.365581 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-75a2fb4c-4d75-479f-8115-def4274c2209 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:39.366932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-75a2fb4c-4d75-479f-8115-def4274c2209 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:39.374416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-75a2fb4c-4d75-479f-8115-def4274c2209 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.374867 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-75a2fb4c-4d75-479f-8115-def4274c2209 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.375827 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-75a2fb4c-4d75-479f-8115-def4274c2209 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.376487 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-75a2fb4c-4d75-479f-8115-def4274c2209 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.544320 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-38d4e929-ea77-4f34-92ac-4183ecc4932c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:39.544927 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-38d4e929-ea77-4f34-92ac-4183ecc4932c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:39.551053 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38d4e929-ea77-4f34-92ac-4183ecc4932c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.551510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38d4e929-ea77-4f34-92ac-4183ecc4932c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.552309 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38d4e929-ea77-4f34-92ac-4183ecc4932c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.552755 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38d4e929-ea77-4f34-92ac-4183ecc4932c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.622467 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-75a2fb4c-4d75-479f-8115-def4274c2209 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:39.633889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-75a2fb4c-4d75-479f-8115-def4274c2209 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.276187 Aug 02 21:44:39.634821 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 227/477] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:39 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:39.690121 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-38d4e929-ea77-4f34-92ac-4183ecc4932c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:39.698133 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-38d4e929-ea77-4f34-92ac-4183ecc4932c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.158140 Aug 02 21:44:39.698704 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 251/478] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:39 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:39.736512 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:39.737131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:39.743270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.743936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.744761 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.745192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.953779 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-493bb20e-bbf2-4321-b808-5abcb4253eea tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:39.954395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-493bb20e-bbf2-4321-b808-5abcb4253eea tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:39.960700 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-493bb20e-bbf2-4321-b808-5abcb4253eea tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.961180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-493bb20e-bbf2-4321-b808-5abcb4253eea tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:39.961959 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-493bb20e-bbf2-4321-b808-5abcb4253eea tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:39.962395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-493bb20e-bbf2-4321-b808-5abcb4253eea tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:40.096852 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-493bb20e-bbf2-4321-b808-5abcb4253eea tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:40.105218 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-493bb20e-bbf2-4321-b808-5abcb4253eea tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.155336 Aug 02 21:44:40.105788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 252/479] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:39 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:40.215654 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:40.223688 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:40.225370 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:40.226544 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-cd42e31e-69ef-4299-a13f-8673d1efecb6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.494210 Aug 02 21:44:40.227112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 228/480] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:39 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:40.482289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-fcf8dd39-8a64-4612-85c7-e8e0deaea048 req-a7dc17f5-559a-4af6-9db5-21af7c050689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a43570-a3a3-44b3-80c6-dc192cc97025", "tag": "ca6af77c-db43-4a8d-9e66-2f05cfd88f76"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:40.491807 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-fcf8dd39-8a64-4612-85c7-e8e0deaea048 req-a7dc17f5-559a-4af6-9db5-21af7c050689 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:40.492302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-fcf8dd39-8a64-4612-85c7-e8e0deaea048 req-a7dc17f5-559a-4af6-9db5-21af7c050689 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:40.503691 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-fcf8dd39-8a64-4612-85c7-e8e0deaea048 req-a7dc17f5-559a-4af6-9db5-21af7c050689 service nova] Creating event network-changed:ca6af77c-db43-4a8d-9e66-2f05cfd88f76 for instance f3a43570-a3a3-44b3-80c6-dc192cc97025 on hv-cinder-85144 Aug 02 21:44:40.508751 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-fcf8dd39-8a64-4612-85c7-e8e0deaea048 req-a7dc17f5-559a-4af6-9db5-21af7c050689 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030053 Aug 02 21:44:40.509342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 253/481] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:40.656921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fe61791b-e867-49d7-8b22-3a439edba920 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:40.657535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fe61791b-e867-49d7-8b22-3a439edba920 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:40.664069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fe61791b-e867-49d7-8b22-3a439edba920 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:40.664567 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fe61791b-e867-49d7-8b22-3a439edba920 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:40.665337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fe61791b-e867-49d7-8b22-3a439edba920 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:40.665763 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fe61791b-e867-49d7-8b22-3a439edba920 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:40.720340 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-38223f65-3874-4770-9370-011b808a0bf6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:40.721042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-38223f65-3874-4770-9370-011b808a0bf6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:40.722923 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:40.728624 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38223f65-3874-4770-9370-011b808a0bf6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:40.729078 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38223f65-3874-4770-9370-011b808a0bf6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:40.729887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38223f65-3874-4770-9370-011b808a0bf6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:40.730325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-38223f65-3874-4770-9370-011b808a0bf6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:40.734618 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=100 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:40.820853 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fe61791b-e867-49d7-8b22-3a439edba920 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:40.828648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fe61791b-e867-49d7-8b22-3a439edba920 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.175771 Aug 02 21:44:40.829413 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 229/482] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:40 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:40.870271 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-38223f65-3874-4770-9370-011b808a0bf6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:40.884636 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-38223f65-3874-4770-9370-011b808a0bf6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.168946 Aug 02 21:44:40.885536 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 254/483] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:40 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:41.126051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b379bca7-d4ff-45a6-b63e-28537c140ced tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:41.126660 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b379bca7-d4ff-45a6-b63e-28537c140ced tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:41.133265 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b379bca7-d4ff-45a6-b63e-28537c140ced tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:41.133729 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b379bca7-d4ff-45a6-b63e-28537c140ced tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:41.134485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b379bca7-d4ff-45a6-b63e-28537c140ced tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:41.134926 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b379bca7-d4ff-45a6-b63e-28537c140ced tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:41.249865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:41.250471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:41.256925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:41.257372 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:41.258139 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:41.258573 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:41.274217 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b379bca7-d4ff-45a6-b63e-28537c140ced tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:41.282458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b379bca7-d4ff-45a6-b63e-28537c140ced tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.160189 Aug 02 21:44:41.283873 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 230/484] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:41 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:41.390400 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:41.399220 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:41.400775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:41.401969 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b04917ad-55e6-4dcb-802c-707c152b82f1 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.155993 Aug 02 21:44:41.402525 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 255/485] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:41 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:41.849871 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1843c11f-c8c1-48a4-b6df-96a437a343d2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:41.850778 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1843c11f-c8c1-48a4-b6df-96a437a343d2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:41.857544 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1843c11f-c8c1-48a4-b6df-96a437a343d2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:41.858170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1843c11f-c8c1-48a4-b6df-96a437a343d2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:41.859155 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1843c11f-c8c1-48a4-b6df-96a437a343d2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:41.859809 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1843c11f-c8c1-48a4-b6df-96a437a343d2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:41.906247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ea710267-7b77-468e-944d-9d3cefccc23a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:41.907864 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ea710267-7b77-468e-944d-9d3cefccc23a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:41.915665 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ea710267-7b77-468e-944d-9d3cefccc23a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:41.916453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ea710267-7b77-468e-944d-9d3cefccc23a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:41.918184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ea710267-7b77-468e-944d-9d3cefccc23a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:41.918800 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ea710267-7b77-468e-944d-9d3cefccc23a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:42.069001 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ea710267-7b77-468e-944d-9d3cefccc23a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:42.078111 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ea710267-7b77-468e-944d-9d3cefccc23a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.175742 Aug 02 21:44:42.078848 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 256/486] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:41 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:42.090760 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1843c11f-c8c1-48a4-b6df-96a437a343d2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:42.099503 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1843c11f-c8c1-48a4-b6df-96a437a343d2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.253629 Aug 02 21:44:42.112556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 231/487] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:41 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:42.303636 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9a203bb7-f56a-4f23-9500-d3b3f9f4cd61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:42.304289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9a203bb7-f56a-4f23-9500-d3b3f9f4cd61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:42.310480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9a203bb7-f56a-4f23-9500-d3b3f9f4cd61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:42.310939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9a203bb7-f56a-4f23-9500-d3b3f9f4cd61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:42.311718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9a203bb7-f56a-4f23-9500-d3b3f9f4cd61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:42.312181 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9a203bb7-f56a-4f23-9500-d3b3f9f4cd61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:42.425494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:42.426105 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:42.432247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:42.432704 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:42.433465 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:42.433928 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:42.454977 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9a203bb7-f56a-4f23-9500-d3b3f9f4cd61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:42.462655 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9a203bb7-f56a-4f23-9500-d3b3f9f4cd61 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.162786 Aug 02 21:44:42.463232 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 257/488] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:42 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:42.610870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:42.619535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:42.621155 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:42.622312 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0988902d-e73e-43cf-8b41-f7784d6c2f00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1738 microversion: 2.20 time: 0.201278 Aug 02 21:44:42.622866 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 232/489] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:42 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:43.101727 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-39f7a33e-ca3b-4e23-93c1-178e08498dc0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:43.102337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-39f7a33e-ca3b-4e23-93c1-178e08498dc0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:43.108922 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-39f7a33e-ca3b-4e23-93c1-178e08498dc0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:43.109376 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-39f7a33e-ca3b-4e23-93c1-178e08498dc0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:43.110144 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-39f7a33e-ca3b-4e23-93c1-178e08498dc0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:43.110578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-39f7a33e-ca3b-4e23-93c1-178e08498dc0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:43.121178 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-072eb19d-568f-4b51-ab3b-63d624852e2a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:43.121831 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-072eb19d-568f-4b51-ab3b-63d624852e2a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:43.129012 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-072eb19d-568f-4b51-ab3b-63d624852e2a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:43.130253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-072eb19d-568f-4b51-ab3b-63d624852e2a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:43.131731 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-072eb19d-568f-4b51-ab3b-63d624852e2a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:43.132193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-072eb19d-568f-4b51-ab3b-63d624852e2a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:43.314774 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-39f7a33e-ca3b-4e23-93c1-178e08498dc0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:43.329343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-39f7a33e-ca3b-4e23-93c1-178e08498dc0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.231007 Aug 02 21:44:43.331445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 258/490] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:43 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:43.390448 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-072eb19d-568f-4b51-ab3b-63d624852e2a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:43.398567 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-072eb19d-568f-4b51-ab3b-63d624852e2a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.281361 Aug 02 21:44:43.399336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 233/491] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:43 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:43.482898 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-53c456ad-954e-46be-b150-f8a8056c3ba5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:43.483515 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-53c456ad-954e-46be-b150-f8a8056c3ba5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:43.490273 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-53c456ad-954e-46be-b150-f8a8056c3ba5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:43.490717 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-53c456ad-954e-46be-b150-f8a8056c3ba5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:43.491487 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-53c456ad-954e-46be-b150-f8a8056c3ba5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:43.491923 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-53c456ad-954e-46be-b150-f8a8056c3ba5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:43.645612 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:43.646147 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:43.652953 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:43.653412 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:43.654191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:43.654631 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:43.706530 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-53c456ad-954e-46be-b150-f8a8056c3ba5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:43.715685 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-53c456ad-954e-46be-b150-f8a8056c3ba5 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.236679 Aug 02 21:44:43.717005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 259/492] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:43 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:43.801627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:43.811684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:43.813264 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:43.814482 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c3448db8-2b00-40b2-ad28-c657b7993455 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1720 microversion: 2.20 time: 0.173404 Aug 02 21:44:43.815189 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 234/493] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:43 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:44.351631 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-16624745-bd1d-4135-b030-328c13293cde tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:44.352286 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-16624745-bd1d-4135-b030-328c13293cde tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:44.358767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16624745-bd1d-4135-b030-328c13293cde tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:44.359223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16624745-bd1d-4135-b030-328c13293cde tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:44.360023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16624745-bd1d-4135-b030-328c13293cde tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:44.360492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16624745-bd1d-4135-b030-328c13293cde tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:44.424240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1130794d-de76-4aba-bba0-c0195ad053d5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:44.424914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1130794d-de76-4aba-bba0-c0195ad053d5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:44.437380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1130794d-de76-4aba-bba0-c0195ad053d5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:44.437837 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1130794d-de76-4aba-bba0-c0195ad053d5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:44.438625 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1130794d-de76-4aba-bba0-c0195ad053d5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:44.439068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1130794d-de76-4aba-bba0-c0195ad053d5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:44.494513 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-16624745-bd1d-4135-b030-328c13293cde tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:44.502570 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-16624745-bd1d-4135-b030-328c13293cde tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.154933 Aug 02 21:44:44.503140 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 260/494] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:44 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:44.576146 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1130794d-de76-4aba-bba0-c0195ad053d5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:44.583553 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1130794d-de76-4aba-bba0-c0195ad053d5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.167041 Aug 02 21:44:44.584118 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 235/495] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:44 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:44.737444 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-efc3cdf3-a953-471d-919c-b168f7ac0b84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:44.737986 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-efc3cdf3-a953-471d-919c-b168f7ac0b84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:44.744005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-efc3cdf3-a953-471d-919c-b168f7ac0b84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:44.744486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-efc3cdf3-a953-471d-919c-b168f7ac0b84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:44.745244 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-efc3cdf3-a953-471d-919c-b168f7ac0b84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:44.745686 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-efc3cdf3-a953-471d-919c-b168f7ac0b84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:44.838210 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:44.838822 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:44.844943 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:44.845908 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:44.846746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:44.847192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:44.884847 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-efc3cdf3-a953-471d-919c-b168f7ac0b84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:44.892393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-efc3cdf3-a953-471d-919c-b168f7ac0b84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.159274 Aug 02 21:44:44.892977 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 261/496] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:44 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:44.976369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:44.984291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:44.985858 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:44.987626 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4f23b716-3066-4ac6-8a9a-5e1ac96ddb82 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1720 microversion: 2.20 time: 0.153329 Aug 02 21:44:44.988112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 236/497] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:44 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:45.524770 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f7ef6e6b-80c9-45e8-9d62-986a00df7ea9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:45.525391 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f7ef6e6b-80c9-45e8-9d62-986a00df7ea9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:45.531937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7ef6e6b-80c9-45e8-9d62-986a00df7ea9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:45.532430 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7ef6e6b-80c9-45e8-9d62-986a00df7ea9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:45.533203 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7ef6e6b-80c9-45e8-9d62-986a00df7ea9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:45.533647 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7ef6e6b-80c9-45e8-9d62-986a00df7ea9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:45.604126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-52862d25-7cfe-4704-8903-52c9d1efaa0e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:45.604793 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-52862d25-7cfe-4704-8903-52c9d1efaa0e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:45.611480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-52862d25-7cfe-4704-8903-52c9d1efaa0e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:45.611941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-52862d25-7cfe-4704-8903-52c9d1efaa0e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:45.612741 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-52862d25-7cfe-4704-8903-52c9d1efaa0e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:45.613183 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-52862d25-7cfe-4704-8903-52c9d1efaa0e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:45.665319 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f7ef6e6b-80c9-45e8-9d62-986a00df7ea9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:45.673609 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f7ef6e6b-80c9-45e8-9d62-986a00df7ea9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.152917 Aug 02 21:44:45.674179 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 262/498] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:45 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:45.747959 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-52862d25-7cfe-4704-8903-52c9d1efaa0e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:45.756183 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-52862d25-7cfe-4704-8903-52c9d1efaa0e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.155892 Aug 02 21:44:45.756753 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 237/499] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:45 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:45.912843 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c5005566-ecd5-487a-b398-a15bd11b0b81 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:45.913518 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c5005566-ecd5-487a-b398-a15bd11b0b81 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:45.919537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c5005566-ecd5-487a-b398-a15bd11b0b81 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:45.919991 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c5005566-ecd5-487a-b398-a15bd11b0b81 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:45.920812 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c5005566-ecd5-487a-b398-a15bd11b0b81 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:45.921253 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c5005566-ecd5-487a-b398-a15bd11b0b81 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:46.010780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:46.011400 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:46.018523 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:46.019554 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:46.019867 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:46.020249 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:46.057597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c5005566-ecd5-487a-b398-a15bd11b0b81 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:46.067109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c5005566-ecd5-487a-b398-a15bd11b0b81 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.157768 Aug 02 21:44:46.067933 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 263/500] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:45 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:46.164213 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:46.166386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=100 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:46.174469 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:46.176037 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:46.177231 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f4e5ff10-bd76-48ed-92bb-8e751becb862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1720 microversion: 2.20 time: 0.170415 Aug 02 21:44:46.177791 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 238/501] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:46 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:46.429622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-1bada3fa-e906-4385-b91f-f5411452ad33 req-253abdd5-1a43-41e1-8e44-f966b149d573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0681fe-f330-40bb-ab1f-86772b3484e5", "name": "network-vif-plugged", "status": "completed", "tag": "c59fcd51-2b42-4947-8a95-8e2d432d140f"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:46.439609 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-1bada3fa-e906-4385-b91f-f5411452ad33 req-253abdd5-1a43-41e1-8e44-f966b149d573 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:46.440159 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-1bada3fa-e906-4385-b91f-f5411452ad33 req-253abdd5-1a43-41e1-8e44-f966b149d573 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:46.452179 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-1bada3fa-e906-4385-b91f-f5411452ad33 req-253abdd5-1a43-41e1-8e44-f966b149d573 service nova] Creating event network-vif-plugged:c59fcd51-2b42-4947-8a95-8e2d432d140f for instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 on hv-cinder-85144 Aug 02 21:44:46.457262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-1bada3fa-e906-4385-b91f-f5411452ad33 req-253abdd5-1a43-41e1-8e44-f966b149d573 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031326 Aug 02 21:44:46.457844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 264/502] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:46.694462 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-882f7ed7-2742-43d4-b15a-3538d227da9c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:46.695086 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-882f7ed7-2742-43d4-b15a-3538d227da9c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:46.701680 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-882f7ed7-2742-43d4-b15a-3538d227da9c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:46.702159 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-882f7ed7-2742-43d4-b15a-3538d227da9c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:46.702910 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-882f7ed7-2742-43d4-b15a-3538d227da9c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:46.703351 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-882f7ed7-2742-43d4-b15a-3538d227da9c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:46.779162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4a67ade3-460b-44a2-8e12-8dac467820ff tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:46.779888 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4a67ade3-460b-44a2-8e12-8dac467820ff tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:46.789544 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4a67ade3-460b-44a2-8e12-8dac467820ff tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:46.790006 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4a67ade3-460b-44a2-8e12-8dac467820ff tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:46.790796 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4a67ade3-460b-44a2-8e12-8dac467820ff tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:46.791251 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4a67ade3-460b-44a2-8e12-8dac467820ff tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:46.855966 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-882f7ed7-2742-43d4-b15a-3538d227da9c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:46.864373 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-882f7ed7-2742-43d4-b15a-3538d227da9c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1723 microversion: 2.1 time: 0.173935 Aug 02 21:44:46.864940 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 239/503] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:46 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:46.982652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4a67ade3-460b-44a2-8e12-8dac467820ff tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:46.990444 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4a67ade3-460b-44a2-8e12-8dac467820ff tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.216011 Aug 02 21:44:46.991014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 265/504] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:46 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:47.087772 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-890999fb-d006-46bb-b55c-6294c0128765 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:47.088423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-890999fb-d006-46bb-b55c-6294c0128765 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:47.094407 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-890999fb-d006-46bb-b55c-6294c0128765 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.094856 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-890999fb-d006-46bb-b55c-6294c0128765 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.095619 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-890999fb-d006-46bb-b55c-6294c0128765 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.096057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-890999fb-d006-46bb-b55c-6294c0128765 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.201659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:47.202275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:47.208886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.209340 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.210104 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.210546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.226018 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-890999fb-d006-46bb-b55c-6294c0128765 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:47.233620 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-890999fb-d006-46bb-b55c-6294c0128765 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.149714 Aug 02 21:44:47.234213 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 240/505] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:47 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:47.339849 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:47.347800 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:47.349325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:47.350484 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-163d5c1e-3ba2-4e59-8446-5f45afa1eeee tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1663 microversion: 2.20 time: 0.152775 Aug 02 21:44:47.351043 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 266/506] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:47 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:47.372766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb087cac-9f31-46f3-a1a0-d6712efed34e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62bd8bcd-09ae-4d9d-ab56-bc02ba53a8bd"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:47.375142 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bb087cac-9f31-46f3-a1a0-d6712efed34e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:47.381619 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb087cac-9f31-46f3-a1a0-d6712efed34e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.382068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb087cac-9f31-46f3-a1a0-d6712efed34e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.382834 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb087cac-9f31-46f3-a1a0-d6712efed34e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.383266 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb087cac-9f31-46f3-a1a0-d6712efed34e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.660256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bb087cac-9f31-46f3-a1a0-d6712efed34e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291400 Aug 02 21:44:47.661034 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 241/507] 10.222.0.57 () {62 vars in 1364 bytes} [Tue Aug 2 21:44:47 2022] POST /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:44:47.786040 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d37ed1b8-1236-4cb7-b892-c4e3978bf1b4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:47.786636 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d37ed1b8-1236-4cb7-b892-c4e3978bf1b4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:47.793361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d37ed1b8-1236-4cb7-b892-c4e3978bf1b4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.793810 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d37ed1b8-1236-4cb7-b892-c4e3978bf1b4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.794573 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d37ed1b8-1236-4cb7-b892-c4e3978bf1b4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.795009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d37ed1b8-1236-4cb7-b892-c4e3978bf1b4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.838045 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d37ed1b8-1236-4cb7-b892-c4e3978bf1b4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124839) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 21:44:47.885612 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9a72f4f5-e305-4049-a146-382b6d21e90c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:47.886247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9a72f4f5-e305-4049-a146-382b6d21e90c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:47.893433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9a72f4f5-e305-4049-a146-382b6d21e90c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.893890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9a72f4f5-e305-4049-a146-382b6d21e90c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.894665 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9a72f4f5-e305-4049-a146-382b6d21e90c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.895107 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9a72f4f5-e305-4049-a146-382b6d21e90c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.903390 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d37ed1b8-1236-4cb7-b892-c4e3978bf1b4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/action" status: 202 len: 0 microversion: 2.20 time: 0.121707 Aug 02 21:44:47.904200 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 267/508] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 2 21:44:47 2022] POST /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:44:47.912290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:47.912910 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:47.919114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.919653 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:47.920542 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:47.921062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.038924 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9a72f4f5-e305-4049-a146-382b6d21e90c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:48.047913 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9a72f4f5-e305-4049-a146-382b6d21e90c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1700 microversion: 2.1 time: 0.166177 Aug 02 21:44:48.049310 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 242/509] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:47 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:48.054223 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb329175-c716-40bc-be35-9f393ebe4a85 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:48.054855 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bb329175-c716-40bc-be35-9f393ebe4a85 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:48.060820 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb329175-c716-40bc-be35-9f393ebe4a85 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:48.061275 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb329175-c716-40bc-be35-9f393ebe4a85 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.062068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb329175-c716-40bc-be35-9f393ebe4a85 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:48.062506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb329175-c716-40bc-be35-9f393ebe4a85 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.084932 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:48.094319 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:48.097128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:48.098335 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-68eea7e0-97b7-42eb-ae88-74323d84820b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1749 microversion: 2.20 time: 0.190238 Aug 02 21:44:48.099022 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 268/510] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:47 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:48.104002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-61b12eb9-dce4-46d3-8f14-f0170969d8e3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:48.110133 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-61b12eb9-dce4-46d3-8f14-f0170969d8e3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:48.110582 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-61b12eb9-dce4-46d3-8f14-f0170969d8e3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.177690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-61b12eb9-dce4-46d3-8f14-f0170969d8e3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Going to try to start instance {{(pid=124839) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 21:44:48.201644 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:48.222772 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-61b12eb9-dce4-46d3-8f14-f0170969d8e3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/action" status: 202 len: 0 microversion: 2.1 time: 0.122272 Aug 02 21:44:48.223361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 269/511] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:44:48 2022] POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:44:48.231853 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b35561fe-6016-416c-a816-5d139b4dd43d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:48.232576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b35561fe-6016-416c-a816-5d139b4dd43d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:48.234421 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb329175-c716-40bc-be35-9f393ebe4a85 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:48.238880 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b35561fe-6016-416c-a816-5d139b4dd43d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:48.239334 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b35561fe-6016-416c-a816-5d139b4dd43d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.240104 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b35561fe-6016-416c-a816-5d139b4dd43d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:48.240564 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b35561fe-6016-416c-a816-5d139b4dd43d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.260423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bb329175-c716-40bc-be35-9f393ebe4a85 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1265 microversion: 2.1 time: 0.209821 Aug 02 21:44:48.277761 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 243/512] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:48 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:48.285578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c00d1421-e821-41df-a847-60dc6d4c6ad2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:48.286568 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c00d1421-e821-41df-a847-60dc6d4c6ad2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:48.296358 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c00d1421-e821-41df-a847-60dc6d4c6ad2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:48.297058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c00d1421-e821-41df-a847-60dc6d4c6ad2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.297993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c00d1421-e821-41df-a847-60dc6d4c6ad2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:48.298608 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c00d1421-e821-41df-a847-60dc6d4c6ad2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.405887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b35561fe-6016-416c-a816-5d139b4dd43d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:48.416082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b35561fe-6016-416c-a816-5d139b4dd43d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1709 microversion: 2.1 time: 0.187638 Aug 02 21:44:48.417014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 270/513] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:48 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:48.476707 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c00d1421-e821-41df-a847-60dc6d4c6ad2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:48.477814 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-f6212f72-52b3-4534-a118-02bfef564ece req-acf792f8-1a07-4da2-816d-3abad91ec867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7248b87b-aba6-40d9-b464-f824c44b1672", "name": "network-vif-plugged", "status": "completed", "tag": "5a4b7f07-13e7-408e-b7d9-3162f37424ed"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:48.484790 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c00d1421-e821-41df-a847-60dc6d4c6ad2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.205164 Aug 02 21:44:48.485458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 244/514] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:48 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:48.488002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-f6212f72-52b3-4534-a118-02bfef564ece req-acf792f8-1a07-4da2-816d-3abad91ec867 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:48.488767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-f6212f72-52b3-4534-a118-02bfef564ece req-acf792f8-1a07-4da2-816d-3abad91ec867 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:48.504914 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-f6212f72-52b3-4534-a118-02bfef564ece req-acf792f8-1a07-4da2-816d-3abad91ec867 service nova] Creating event network-vif-plugged:5a4b7f07-13e7-408e-b7d9-3162f37424ed for instance 7248b87b-aba6-40d9-b464-f824c44b1672 on hv-cinder-85144 Aug 02 21:44:48.510853 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-f6212f72-52b3-4534-a118-02bfef564ece req-acf792f8-1a07-4da2-816d-3abad91ec867 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037184 Aug 02 21:44:48.511730 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 271/515] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:44:49.129868 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:49.130682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:49.143746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.144235 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.147521 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.148075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.288047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ad1313bc-140c-4ba8-8426-bcf7e9b150f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:49.288913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ad1313bc-140c-4ba8-8426-bcf7e9b150f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:49.295781 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad1313bc-140c-4ba8-8426-bcf7e9b150f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.296397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad1313bc-140c-4ba8-8426-bcf7e9b150f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.297860 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad1313bc-140c-4ba8-8426-bcf7e9b150f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.298360 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad1313bc-140c-4ba8-8426-bcf7e9b150f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.303815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:49.313238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:49.317643 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:49.319150 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ee1ad4c0-7ad5-47c4-aeae-aa50e62c1eed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1749 microversion: 2.20 time: 0.196093 Aug 02 21:44:49.320403 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 245/516] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:49 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:49.442461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5522070d-319b-42bd-b7dc-9391f686b837 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:49.445120 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5522070d-319b-42bd-b7dc-9391f686b837 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:49.451691 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5522070d-319b-42bd-b7dc-9391f686b837 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.452483 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5522070d-319b-42bd-b7dc-9391f686b837 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.453409 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5522070d-319b-42bd-b7dc-9391f686b837 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.454027 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5522070d-319b-42bd-b7dc-9391f686b837 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.519706 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ad1313bc-140c-4ba8-8426-bcf7e9b150f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:49.527596 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ad1313bc-140c-4ba8-8426-bcf7e9b150f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1452 microversion: 2.1 time: 0.248708 Aug 02 21:44:49.528185 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 272/517] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:49 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1452 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:49.533171 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-cce10a8f-5ed4-41b2-a2d1-6d311db5c4d2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:49.534139 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-cce10a8f-5ed4-41b2-a2d1-6d311db5c4d2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:49.540119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cce10a8f-5ed4-41b2-a2d1-6d311db5c4d2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.540775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cce10a8f-5ed4-41b2-a2d1-6d311db5c4d2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.541545 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cce10a8f-5ed4-41b2-a2d1-6d311db5c4d2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.542143 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cce10a8f-5ed4-41b2-a2d1-6d311db5c4d2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.587380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5522070d-319b-42bd-b7dc-9391f686b837 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:49.595898 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5522070d-319b-42bd-b7dc-9391f686b837 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1709 microversion: 2.1 time: 0.161419 Aug 02 21:44:49.596502 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 246/518] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:49 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:49.600945 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9eee94a5-9694-4ade-a280-56e9a11503d1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:49.601684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9eee94a5-9694-4ade-a280-56e9a11503d1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:49.607580 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9eee94a5-9694-4ade-a280-56e9a11503d1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.608037 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9eee94a5-9694-4ade-a280-56e9a11503d1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.609064 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9eee94a5-9694-4ade-a280-56e9a11503d1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:49.609674 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9eee94a5-9694-4ade-a280-56e9a11503d1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:49.679077 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cce10a8f-5ed4-41b2-a2d1-6d311db5c4d2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:49.686758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-cce10a8f-5ed4-41b2-a2d1-6d311db5c4d2 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.157610 Aug 02 21:44:49.687398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 273/519] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:49 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:49.743152 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9eee94a5-9694-4ade-a280-56e9a11503d1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:49.750621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9eee94a5-9694-4ade-a280-56e9a11503d1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1452 microversion: 2.1 time: 0.153184 Aug 02 21:44:49.751181 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 247/520] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:49 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:50.342863 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:50.343497 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:50.351156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:50.351610 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:50.352498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:50.352937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:50.493042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:50.502117 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:50.503922 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:50.505259 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e6227d0c-207a-4a69-b439-d63127b36082 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1751 microversion: 2.20 time: 0.166294 Aug 02 21:44:50.505957 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 274/521] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:50 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:50.526487 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-f45555a6-f2bc-4c4c-908d-a50cc2158d4e req-0e5a84f1-2092-47a1-8a4e-ad96c85b7766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "581dd5c7-3160-47ed-ac20-6d35cbd6604c", "name": "network-vif-unplugged", "status": "completed", "tag": "1b078072-8634-47d5-b163-fe8eb6da769b"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:50.537331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-f45555a6-f2bc-4c4c-908d-a50cc2158d4e req-0e5a84f1-2092-47a1-8a4e-ad96c85b7766 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:50.537885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-f45555a6-f2bc-4c4c-908d-a50cc2158d4e req-0e5a84f1-2092-47a1-8a4e-ad96c85b7766 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:50.553983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.compute.server_external_events [req-f45555a6-f2bc-4c4c-908d-a50cc2158d4e req-0e5a84f1-2092-47a1-8a4e-ad96c85b7766 service nova] Unable to find a host for instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c. Dropping event network-vif-unplugged {{(pid=124840) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 21:44:50.554911 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-f45555a6-f2bc-4c4c-908d-a50cc2158d4e req-0e5a84f1-2092-47a1-8a4e-ad96c85b7766 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032525 Aug 02 21:44:50.555519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 248/522] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 02 21:44:50.617331 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a9c8ca72-14d2-44f0-9a62-7211aa7a6315 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:50.618436 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a9c8ca72-14d2-44f0-9a62-7211aa7a6315 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:50.624907 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a9c8ca72-14d2-44f0-9a62-7211aa7a6315 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:50.625439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a9c8ca72-14d2-44f0-9a62-7211aa7a6315 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:50.626589 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a9c8ca72-14d2-44f0-9a62-7211aa7a6315 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:50.627372 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a9c8ca72-14d2-44f0-9a62-7211aa7a6315 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:50.713445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-81e11eda-719e-4f0d-8cf8-05905fb1b1e1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:50.714055 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-81e11eda-719e-4f0d-8cf8-05905fb1b1e1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:50.716126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=100 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:50.727670 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81e11eda-719e-4f0d-8cf8-05905fb1b1e1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:50.728115 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81e11eda-719e-4f0d-8cf8-05905fb1b1e1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:50.728926 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81e11eda-719e-4f0d-8cf8-05905fb1b1e1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:50.729517 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-81e11eda-719e-4f0d-8cf8-05905fb1b1e1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:50.794398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a9c8ca72-14d2-44f0-9a62-7211aa7a6315 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:50.803466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a9c8ca72-14d2-44f0-9a62-7211aa7a6315 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1709 microversion: 2.1 time: 0.189608 Aug 02 21:44:50.809213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 275/523] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:50 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:50.973343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-81e11eda-719e-4f0d-8cf8-05905fb1b1e1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:50.981093 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-81e11eda-719e-4f0d-8cf8-05905fb1b1e1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1258 microversion: 2.1 time: 0.271537 Aug 02 21:44:50.981686 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 249/524] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:50 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1258 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:51.529447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:51.530089 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:51.537679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:51.538067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:51.538859 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:51.539304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:51.683198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:51.691777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:51.693291 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:51.694455 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-621f528a-925f-41a1-8e45-d4c9d3d9ad08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1751 microversion: 2.20 time: 0.168916 Aug 02 21:44:51.695016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 276/525] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:51 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:51.801901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-f685f43c-6b13-467d-b121-0cd66a7c942c req-db490bd2-a180-494c-90fb-4822e6274767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0681fe-f330-40bb-ab1f-86772b3484e5", "tag": "c59fcd51-2b42-4947-8a95-8e2d432d140f"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:51.811502 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-f685f43c-6b13-467d-b121-0cd66a7c942c req-db490bd2-a180-494c-90fb-4822e6274767 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:51.811951 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-f685f43c-6b13-467d-b121-0cd66a7c942c req-db490bd2-a180-494c-90fb-4822e6274767 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:51.822900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-f685f43c-6b13-467d-b121-0cd66a7c942c req-db490bd2-a180-494c-90fb-4822e6274767 service nova] Creating event network-changed:c59fcd51-2b42-4947-8a95-8e2d432d140f for instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 on hv-cinder-85144 Aug 02 21:44:51.824828 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ded6a6f4-c6c5-41af-b60b-18c190b4bb89 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:51.825550 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ded6a6f4-c6c5-41af-b60b-18c190b4bb89 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:51.828111 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-f685f43c-6b13-467d-b121-0cd66a7c942c req-db490bd2-a180-494c-90fb-4822e6274767 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030254 Aug 02 21:44:51.828768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 250/526] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:51.833352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ded6a6f4-c6c5-41af-b60b-18c190b4bb89 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:51.833867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ded6a6f4-c6c5-41af-b60b-18c190b4bb89 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:51.834699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ded6a6f4-c6c5-41af-b60b-18c190b4bb89 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:51.835206 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ded6a6f4-c6c5-41af-b60b-18c190b4bb89 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:51.980638 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ded6a6f4-c6c5-41af-b60b-18c190b4bb89 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:51.988580 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ded6a6f4-c6c5-41af-b60b-18c190b4bb89 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1709 microversion: 2.1 time: 0.167703 Aug 02 21:44:51.989144 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 277/527] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:51 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:44:52.001384 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-44628267-d2d1-40d9-9437-ba286bbae8d1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:52.002408 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-44628267-d2d1-40d9-9437-ba286bbae8d1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:52.008767 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-44628267-d2d1-40d9-9437-ba286bbae8d1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:52.009331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-44628267-d2d1-40d9-9437-ba286bbae8d1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:52.010174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-44628267-d2d1-40d9-9437-ba286bbae8d1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:52.010684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-44628267-d2d1-40d9-9437-ba286bbae8d1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:52.155921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-44628267-d2d1-40d9-9437-ba286bbae8d1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:52.166675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-44628267-d2d1-40d9-9437-ba286bbae8d1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1440 microversion: 2.1 time: 0.169120 Aug 02 21:44:52.167887 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 251/528] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:51 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1440 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:52.187247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5aef55bd-acd6-49e7-9bb5-7788ee9627c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:52.187867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5aef55bd-acd6-49e7-9bb5-7788ee9627c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:52.193903 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5aef55bd-acd6-49e7-9bb5-7788ee9627c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:52.194361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5aef55bd-acd6-49e7-9bb5-7788ee9627c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:52.195131 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5aef55bd-acd6-49e7-9bb5-7788ee9627c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:52.195576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5aef55bd-acd6-49e7-9bb5-7788ee9627c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:52.379135 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5aef55bd-acd6-49e7-9bb5-7788ee9627c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:52.386674 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5aef55bd-acd6-49e7-9bb5-7788ee9627c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1440 microversion: 2.1 time: 0.203261 Aug 02 21:44:52.387311 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 278/529] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:52 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1440 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:52.718182 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:52.718932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:52.725986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:52.726533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:52.727464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:52.727976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:52.875917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:52.885906 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:52.887630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:52.888829 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4ff6be31-0e30-426f-8a0c-c5aaafff3813 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1751 microversion: 2.20 time: 0.174990 Aug 02 21:44:52.889630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 252/530] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:52 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:53.009156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a612edf1-f663-48ea-b813-d56ff67ac52c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:53.009770 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a612edf1-f663-48ea-b813-d56ff67ac52c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:53.017699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a612edf1-f663-48ea-b813-d56ff67ac52c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:53.018148 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a612edf1-f663-48ea-b813-d56ff67ac52c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:53.018922 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a612edf1-f663-48ea-b813-d56ff67ac52c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:53.019695 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a612edf1-f663-48ea-b813-d56ff67ac52c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:53.289699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a612edf1-f663-48ea-b813-d56ff67ac52c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:53.297793 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a612edf1-f663-48ea-b813-d56ff67ac52c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1713 microversion: 2.1 time: 0.292489 Aug 02 21:44:53.298564 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 279/531] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:44:53 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1713 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:44:53.913883 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:53.914733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:53.924034 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:53.924741 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:53.925532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:53.926135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:54.069534 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:54.078012 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:54.079549 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:54.080734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ab7b5bc6-f6d8-4215-ae13-1e3bf8c7c315 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.171681 Aug 02 21:44:54.081287 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 253/532] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:53 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:44:54.790835 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-c7b35d9b-4696-4744-9bb3-d9b06a348e43 req-6b04b2b6-388a-4a2d-913c-a34ddd905004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7248b87b-aba6-40d9-b464-f824c44b1672", "tag": "5a4b7f07-13e7-408e-b7d9-3162f37424ed"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:44:54.818291 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-c7b35d9b-4696-4744-9bb3-d9b06a348e43 req-6b04b2b6-388a-4a2d-913c-a34ddd905004 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:54.820434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-c7b35d9b-4696-4744-9bb3-d9b06a348e43 req-6b04b2b6-388a-4a2d-913c-a34ddd905004 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:54.846980 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-c7b35d9b-4696-4744-9bb3-d9b06a348e43 req-6b04b2b6-388a-4a2d-913c-a34ddd905004 service nova] Creating event network-changed:5a4b7f07-13e7-408e-b7d9-3162f37424ed for instance 7248b87b-aba6-40d9-b464-f824c44b1672 on hv-cinder-85144 Aug 02 21:44:54.852377 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-c7b35d9b-4696-4744-9bb3-d9b06a348e43 req-6b04b2b6-388a-4a2d-913c-a34ddd905004 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065338 Aug 02 21:44:54.853195 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 280/533] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:44:55.104779 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:55.105935 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:55.114084 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:55.128928 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:55.129802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:55.130247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:55.133465 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:55.279401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:55.288420 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:55.290003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:55.291174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ea35894a-08d4-4cf6-94c7-57480a74dadb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.190346 Aug 02 21:44:55.291942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 254/534] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:55 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:56.315961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:56.316870 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:56.323263 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:56.323719 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:56.325567 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:56.326115 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:56.460329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:56.469067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:56.470597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:56.471864 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2d9c3c31-ce30-429f-a85d-c9c525e4897a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.161131 Aug 02 21:44:56.472459 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 281/535] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:56 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:57.495287 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:57.495889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:57.502994 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:57.503444 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:57.504227 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:57.504670 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:57.652590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:57.661631 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:57.663192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:57.664421 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9af72ea7-4077-4cf0-a475-58280da25f3a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.173156 Aug 02 21:44:57.664990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 255/536] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:57 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:58.686958 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:58.687603 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:58.694659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:58.695116 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:58.695904 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:58.696375 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:58.888496 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:58.898368 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:58.900158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:44:58.901355 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3f0d3c8b-6fcd-4755-8206-ee5c3c412493 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.218379 Aug 02 21:44:58.901911 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 282/537] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:58 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:44:59.925988 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:44:59.926610 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:44:59.933484 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:59.933939 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:44:59.934721 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:44:59.935161 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:00.128925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:00.138023 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:00.139733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:00.140978 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-07bcb6b9-a8d9-47e9-8f36-273dfc5b6f51 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.219556 Aug 02 21:45:00.142094 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 256/538] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:44:59 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:01.165061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:01.165669 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:01.172405 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:01.173424 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:01.174216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:01.174662 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:01.319306 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:01.328620 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:01.330303 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:01.331491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c6ff0907-d610-44f4-9853-9151b603c37b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.170403 Aug 02 21:45:01.332056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 283/539] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:01 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:02.355170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:02.358301 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:02.365229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:02.365687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:02.366481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:02.366925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:02.550847 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:02.559638 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:02.561221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:02.562447 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5e5f79c3-37c0-4aae-a5e7-6a21c188af68 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.211138 Aug 02 21:45:02.562959 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 257/540] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:02 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:03.588312 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:03.588914 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:03.595259 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:03.595723 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:03.596635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:03.597082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:03.731115 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:03.739918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:03.741452 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:03.742633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3d5fc50b-5227-4cfa-9125-c763f2b35b18 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.158468 Aug 02 21:45:03.743197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 284/541] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:03 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:04.767013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:04.767739 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:04.774388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:04.774870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:04.775655 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:04.776091 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:04.916933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:04.925435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:04.926980 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:04.928158 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0b36fdf9-67fd-43ad-928b-5a0bd1cdd877 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.166168 Aug 02 21:45:04.928716 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 258/542] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:04 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:05.952717 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:05.953351 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:05.960234 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:05.960697 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:05.961514 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:05.961960 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:06.097403 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:06.105833 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:06.107340 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:06.108531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-54552d1e-e734-4c26-bae8-cbd59536bf28 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.159868 Aug 02 21:45:06.109095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 285/543] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:05 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:07.132954 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:07.133533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:07.140123 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:07.140594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:07.141406 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:07.141867 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:07.273158 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:07.282340 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:07.285216 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:07.287371 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-79dd895f-2adf-4fd9-bc3f-d130ad3380e6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.158350 Aug 02 21:45:07.288767 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 259/544] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:07 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:08.310978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:08.311588 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:08.318621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:08.319073 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:08.319851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:08.320328 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:08.447006 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:08.455308 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:08.456856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:08.458016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8e1afd6b-d16a-477a-8664-63b9ae7a1f84 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.150913 Aug 02 21:45:08.458572 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 286/545] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:08 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:09.480705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:09.481323 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:09.487822 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:09.488308 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:09.489080 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:09.489524 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:09.621830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:09.630947 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:09.632532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:09.633889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-73374a43-d087-4f20-aed5-be79db9618da tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.157010 Aug 02 21:45:09.634439 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 260/546] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:09 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:10.658412 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:10.659024 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:10.667082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:10.667539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:10.668356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:10.668797 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:10.683255 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:10.797421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:10.806017 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:10.807513 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:10.808777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-58eb33fa-fec5-4031-b4dc-60a5872ef01d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.154880 Aug 02 21:45:10.809333 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 287/547] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:10 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:11.831042 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:11.831652 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:11.837924 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:11.838374 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:11.839139 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:11.839572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:11.965779 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:11.975025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:11.976610 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:11.977808 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5e03dd6c-a150-4218-b3cf-e6819724ff30 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.150824 Aug 02 21:45:11.978370 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 261/548] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:11 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:13.102366 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:13.102995 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:13.104859 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:13.110269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:13.110748 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:13.111521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:13.111966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:13.240254 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:13.248713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:13.250718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:13.251876 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-288fc869-5033-439e-ad8d-d6cad734cd6b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.254696 Aug 02 21:45:13.252481 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 288/549] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:12 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:14.275460 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:14.276077 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:14.283049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:14.283500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:14.284299 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:14.284812 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:14.416735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:14.425162 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:14.426702 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:14.428032 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3ad0b492-5e66-4312-8bc4-29befac3cdec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.156607 Aug 02 21:45:14.428451 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 262/550] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:14 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:15.450582 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:15.451311 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:15.459061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:15.460017 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:15.460971 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:15.461423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:15.662879 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:15.671503 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:15.673585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:15.674822 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6b2a3bc8-6480-4b8e-9f5b-6c7b2cbee6e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.228237 Aug 02 21:45:15.675320 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 289/551] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:15 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:16.697651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:16.698272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:16.704778 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:16.705235 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:16.706003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:16.706440 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:16.838148 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:16.846528 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:16.848057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:16.849244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e2808602-a68c-49b5-9575-e92f727ca475 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.155527 Aug 02 21:45:16.849802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 263/552] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:16 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:17.871786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:17.872453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:17.879560 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:17.880011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:17.880813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:17.881252 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:18.008568 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:18.016823 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:18.018314 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:18.019461 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-602e89c8-02ac-4143-8487-0d04c2b4de39 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.151518 Aug 02 21:45:18.020085 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 290/553] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:17 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:19.044235 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:19.044850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:19.052197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:19.052622 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:19.053414 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:19.054004 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:19.182286 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:19.191286 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:19.192887 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:19.195049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5889850c-9d86-4096-9ae9-d65f242807e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.154812 Aug 02 21:45:19.195614 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 264/554] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:19 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:20.217830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:20.218967 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:20.225472 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:20.225930 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:20.226702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:20.227147 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:20.357751 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:20.366920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:20.368446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:20.369606 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-bcf30de5-c04b-44f6-a6a8-b7beb653eb1d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.155724 Aug 02 21:45:20.370164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 291/555] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:20 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:21.392748 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:21.393367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:21.395816 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=32 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:21.401556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:21.402039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:21.402835 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:21.403279 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:21.533105 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:21.541485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:21.543026 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:21.544231 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5aae59e3-ef0d-4c3a-bf06-8504f087ebf5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.155498 Aug 02 21:45:21.544795 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 265/556] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:21 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:22.568659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:22.569247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:22.575739 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:22.576199 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:22.576970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:22.577405 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:22.708276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:22.716656 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:22.718149 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:22.719302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c40bb7fa-a301-4211-8c88-b06f83ef3b42 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.154541 Aug 02 21:45:22.719846 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 292/557] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:22 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:23.403294 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-3d35c1d5-b8d3-4d80-ad01-430f0e512a7b req-e99b714c-4a81-4bd9-93a6-38ac7ad3b42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "581dd5c7-3160-47ed-ac20-6d35cbd6604c", "name": "network-vif-plugged", "status": "completed", "tag": "1b078072-8634-47d5-b163-fe8eb6da769b"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:45:23.425525 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-3d35c1d5-b8d3-4d80-ad01-430f0e512a7b req-e99b714c-4a81-4bd9-93a6-38ac7ad3b42d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:23.426069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-3d35c1d5-b8d3-4d80-ad01-430f0e512a7b req-e99b714c-4a81-4bd9-93a6-38ac7ad3b42d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:23.437068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-3d35c1d5-b8d3-4d80-ad01-430f0e512a7b req-e99b714c-4a81-4bd9-93a6-38ac7ad3b42d service nova] Creating event network-vif-plugged:1b078072-8634-47d5-b163-fe8eb6da769b for instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c on hv-cinder-85144 Aug 02 21:45:23.442075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-3d35c1d5-b8d3-4d80-ad01-430f0e512a7b req-e99b714c-4a81-4bd9-93a6-38ac7ad3b42d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042464 Aug 02 21:45:23.442884 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 266/558] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:45:23.742428 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:23.742937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:23.749360 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:23.750301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:23.751058 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:23.751491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:23.881386 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:23.889867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:23.892053 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:23.893247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-76d6449c-b151-4d21-b7f8-4380e56b67ed tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.154802 Aug 02 21:45:23.893801 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 293/559] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:23 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:24.917424 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:24.918125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:24.924475 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:24.924931 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:24.925728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:24.926173 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:25.052672 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:25.061004 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:25.062552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:25.063711 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-41af4ab0-4127-46d4-970b-b23ad0d5e356 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.151192 Aug 02 21:45:25.064309 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 267/560] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:24 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:26.086455 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:26.087074 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:26.094121 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:26.094578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:26.095346 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:26.095786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:26.224155 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:26.232609 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:26.234743 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:26.235902 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7867604e-c290-43b6-9b72-37de9e66a862 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.153318 Aug 02 21:45:26.236517 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 294/561] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:26 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:27.259247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:27.259819 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:27.267413 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:27.267873 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:27.268685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:27.269168 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:27.273575 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=80 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:27.400777 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:27.409172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:27.410723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:27.411884 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0e197b6f-5d96-43a4-96dc-2052552c1caf tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1807 microversion: 2.20 time: 0.157272 Aug 02 21:45:27.412479 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 268/562] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:27 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:28.435295 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:28.435839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:28.442858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:28.443313 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:28.444081 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:28.444549 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:28.576978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:28.586145 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:28.587646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:28.588857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-090ad174-8d87-4134-b875-5878fadccb07 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1794 microversion: 2.20 time: 0.157592 Aug 02 21:45:28.589427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 295/563] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:45:28 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:45:44.167279 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-78f0a667-bc39-44df-b6cd-57d69cc995e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4ed1db7-6ecb-4fc5-83e4-29e8e554891e"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:45:44.169657 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-78f0a667-bc39-44df-b6cd-57d69cc995e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:44.172277 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=7 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:44.172914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=5 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:44.178714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-78f0a667-bc39-44df-b6cd-57d69cc995e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:44.179163 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-78f0a667-bc39-44df-b6cd-57d69cc995e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:44.179925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-78f0a667-bc39-44df-b6cd-57d69cc995e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:44.180396 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-78f0a667-bc39-44df-b6cd-57d69cc995e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:44.439633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-78f0a667-bc39-44df-b6cd-57d69cc995e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276795 Aug 02 21:45:44.440143 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 269/564] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:45:44 2022] POST /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:45:51.960027 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-cd454925-d446-434a-8235-eaebc3083efb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:45:51.962334 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-cd454925-d446-434a-8235-eaebc3083efb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:51.964578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=15 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:51.965232 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=51 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:51.971439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cd454925-d446-434a-8235-eaebc3083efb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:51.971901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cd454925-d446-434a-8235-eaebc3083efb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:51.972721 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cd454925-d446-434a-8235-eaebc3083efb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:51.973169 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cd454925-d446-434a-8235-eaebc3083efb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:51.995560 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-cd454925-d446-434a-8235-eaebc3083efb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lazy-loading 'flavor' on Instance uuid 3a9e4798-b622-408c-badf-10489a6cc310 {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:45:52.114427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-cd454925-d446-434a-8235-eaebc3083efb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/action" status: 200 len: 32 microversion: 2.1 time: 0.158463 Aug 02 21:45:52.115024 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 296/565] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:45:51 2022] POST /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:45:52.126507 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e364966e-6430-43a1-8619-d21bfbf6e47e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:52.127221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e364966e-6430-43a1-8619-d21bfbf6e47e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:52.133627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e364966e-6430-43a1-8619-d21bfbf6e47e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:52.134084 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e364966e-6430-43a1-8619-d21bfbf6e47e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:52.134856 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e364966e-6430-43a1-8619-d21bfbf6e47e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:52.135308 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e364966e-6430-43a1-8619-d21bfbf6e47e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:52.267610 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e364966e-6430-43a1-8619-d21bfbf6e47e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:52.275898 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e364966e-6430-43a1-8619-d21bfbf6e47e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.154643 Aug 02 21:45:52.276501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 270/566] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:45:52 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:45:53.298856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2c58a17f-7068-46ca-8cb2-db6a455cdb01 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:53.299559 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2c58a17f-7068-46ca-8cb2-db6a455cdb01 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:53.306260 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c58a17f-7068-46ca-8cb2-db6a455cdb01 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:53.306713 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c58a17f-7068-46ca-8cb2-db6a455cdb01 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:53.307478 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c58a17f-7068-46ca-8cb2-db6a455cdb01 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:53.307916 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c58a17f-7068-46ca-8cb2-db6a455cdb01 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:53.439135 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2c58a17f-7068-46ca-8cb2-db6a455cdb01 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:53.452998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2c58a17f-7068-46ca-8cb2-db6a455cdb01 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.157315 Aug 02 21:45:53.453568 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 297/567] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:45:53 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:45:54.475206 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-22b14aa2-fd39-4a36-8086-1fe1448e58f9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:54.475822 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-22b14aa2-fd39-4a36-8086-1fe1448e58f9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:54.482429 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-22b14aa2-fd39-4a36-8086-1fe1448e58f9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:54.482885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-22b14aa2-fd39-4a36-8086-1fe1448e58f9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:54.484242 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-22b14aa2-fd39-4a36-8086-1fe1448e58f9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:54.484684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-22b14aa2-fd39-4a36-8086-1fe1448e58f9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:54.611876 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-22b14aa2-fd39-4a36-8086-1fe1448e58f9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:54.620933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-22b14aa2-fd39-4a36-8086-1fe1448e58f9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.149661 Aug 02 21:45:54.621506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 271/568] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:45:54 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:45:55.642991 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ee8bef22-d845-4757-b81f-1482904ce087 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:55.643603 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ee8bef22-d845-4757-b81f-1482904ce087 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:55.650326 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ee8bef22-d845-4757-b81f-1482904ce087 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:55.650783 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ee8bef22-d845-4757-b81f-1482904ce087 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:55.651546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ee8bef22-d845-4757-b81f-1482904ce087 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:55.651984 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ee8bef22-d845-4757-b81f-1482904ce087 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:56.001463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ee8bef22-d845-4757-b81f-1482904ce087 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:56.009371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ee8bef22-d845-4757-b81f-1482904ce087 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.370376 Aug 02 21:45:56.009934 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 298/569] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:45:55 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:45:57.030877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-facf6ff0-1a01-4180-b8b2-6e3828503259 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:57.031496 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-facf6ff0-1a01-4180-b8b2-6e3828503259 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:57.038122 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-facf6ff0-1a01-4180-b8b2-6e3828503259 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:57.038576 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-facf6ff0-1a01-4180-b8b2-6e3828503259 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:57.039341 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-facf6ff0-1a01-4180-b8b2-6e3828503259 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:57.039774 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-facf6ff0-1a01-4180-b8b2-6e3828503259 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:57.169031 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-facf6ff0-1a01-4180-b8b2-6e3828503259 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:57.177453 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-facf6ff0-1a01-4180-b8b2-6e3828503259 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.150500 Aug 02 21:45:57.178015 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 272/570] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:45:57 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:45:58.198918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6e85ba75-3bac-4aee-8f7b-9023b6bb7be6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:58.199563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6e85ba75-3bac-4aee-8f7b-9023b6bb7be6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:58.206690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6e85ba75-3bac-4aee-8f7b-9023b6bb7be6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:58.207145 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6e85ba75-3bac-4aee-8f7b-9023b6bb7be6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:58.207918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6e85ba75-3bac-4aee-8f7b-9023b6bb7be6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:58.208393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6e85ba75-3bac-4aee-8f7b-9023b6bb7be6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:58.333747 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6e85ba75-3bac-4aee-8f7b-9023b6bb7be6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:58.341698 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6e85ba75-3bac-4aee-8f7b-9023b6bb7be6 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.146721 Aug 02 21:45:58.342259 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 299/571] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:45:58 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:45:59.363016 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-10294cbc-145b-454c-ad97-886eb6e4abbf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:45:59.363679 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-10294cbc-145b-454c-ad97-886eb6e4abbf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:45:59.370172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-10294cbc-145b-454c-ad97-886eb6e4abbf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:59.370633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-10294cbc-145b-454c-ad97-886eb6e4abbf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:59.371402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-10294cbc-145b-454c-ad97-886eb6e4abbf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:45:59.371846 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-10294cbc-145b-454c-ad97-886eb6e4abbf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:45:59.500356 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-10294cbc-145b-454c-ad97-886eb6e4abbf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:45:59.508209 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-10294cbc-145b-454c-ad97-886eb6e4abbf tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.149069 Aug 02 21:45:59.508776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 273/572] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:45:59 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:00.531116 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7f43e1e5-2c71-4c34-8e46-0b40f9ac645e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:00.531738 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7f43e1e5-2c71-4c34-8e46-0b40f9ac645e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:00.538394 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f43e1e5-2c71-4c34-8e46-0b40f9ac645e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:00.538851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f43e1e5-2c71-4c34-8e46-0b40f9ac645e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:00.539629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f43e1e5-2c71-4c34-8e46-0b40f9ac645e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:00.540072 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f43e1e5-2c71-4c34-8e46-0b40f9ac645e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:00.669998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7f43e1e5-2c71-4c34-8e46-0b40f9ac645e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:00.677875 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7f43e1e5-2c71-4c34-8e46-0b40f9ac645e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.151309 Aug 02 21:46:00.678434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 300/573] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:00 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:01.698629 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c90d4a56-16d0-4d0f-987a-a7e05257edde tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:01.699250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c90d4a56-16d0-4d0f-987a-a7e05257edde tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:01.705876 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c90d4a56-16d0-4d0f-987a-a7e05257edde tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:01.706333 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c90d4a56-16d0-4d0f-987a-a7e05257edde tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:01.707106 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c90d4a56-16d0-4d0f-987a-a7e05257edde tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:01.707547 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c90d4a56-16d0-4d0f-987a-a7e05257edde tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:01.849645 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c90d4a56-16d0-4d0f-987a-a7e05257edde tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:01.858492 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c90d4a56-16d0-4d0f-987a-a7e05257edde tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.163258 Aug 02 21:46:01.859061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 274/574] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:01 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:02.878971 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0b97f511-0b2c-4c2c-95b0-2ad59e0bd086 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:02.879484 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0b97f511-0b2c-4c2c-95b0-2ad59e0bd086 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:02.886657 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b97f511-0b2c-4c2c-95b0-2ad59e0bd086 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:02.887105 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b97f511-0b2c-4c2c-95b0-2ad59e0bd086 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:02.888103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b97f511-0b2c-4c2c-95b0-2ad59e0bd086 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:02.888338 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0b97f511-0b2c-4c2c-95b0-2ad59e0bd086 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:03.020191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0b97f511-0b2c-4c2c-95b0-2ad59e0bd086 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:03.028384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0b97f511-0b2c-4c2c-95b0-2ad59e0bd086 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.153464 Aug 02 21:46:03.028996 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 301/575] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:02 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:04.052328 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-806b4498-35ca-46c5-975e-9c94b86f2f8a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:04.052941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-806b4498-35ca-46c5-975e-9c94b86f2f8a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:04.059501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-806b4498-35ca-46c5-975e-9c94b86f2f8a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:04.059959 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-806b4498-35ca-46c5-975e-9c94b86f2f8a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:04.061281 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-806b4498-35ca-46c5-975e-9c94b86f2f8a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:04.061722 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-806b4498-35ca-46c5-975e-9c94b86f2f8a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:04.190500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-806b4498-35ca-46c5-975e-9c94b86f2f8a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:04.198516 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-806b4498-35ca-46c5-975e-9c94b86f2f8a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.150592 Aug 02 21:46:04.199112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 275/576] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:04 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:05.220260 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-63b25128-dee9-459e-92da-f2a2740fcf89 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:05.220801 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-63b25128-dee9-459e-92da-f2a2740fcf89 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:05.226812 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-63b25128-dee9-459e-92da-f2a2740fcf89 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:05.227269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-63b25128-dee9-459e-92da-f2a2740fcf89 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:05.228036 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-63b25128-dee9-459e-92da-f2a2740fcf89 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:05.228513 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-63b25128-dee9-459e-92da-f2a2740fcf89 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:05.370542 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-63b25128-dee9-459e-92da-f2a2740fcf89 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:05.379322 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-63b25128-dee9-459e-92da-f2a2740fcf89 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.163161 Aug 02 21:46:05.379893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 302/577] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:05 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:06.401062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a86dec88-b6a0-4d27-8d7a-ea3167c8ebaa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:06.401713 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a86dec88-b6a0-4d27-8d7a-ea3167c8ebaa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:06.409039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a86dec88-b6a0-4d27-8d7a-ea3167c8ebaa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:06.409494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a86dec88-b6a0-4d27-8d7a-ea3167c8ebaa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:06.410297 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a86dec88-b6a0-4d27-8d7a-ea3167c8ebaa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:06.410733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a86dec88-b6a0-4d27-8d7a-ea3167c8ebaa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:06.542256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a86dec88-b6a0-4d27-8d7a-ea3167c8ebaa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:06.550342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a86dec88-b6a0-4d27-8d7a-ea3167c8ebaa tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1734 microversion: 2.1 time: 0.153298 Aug 02 21:46:06.550912 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 276/578] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:06 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:07.571815 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-cc953145-05ce-4cf1-bd02-e62421f0710f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:07.572479 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-cc953145-05ce-4cf1-bd02-e62421f0710f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:07.579134 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cc953145-05ce-4cf1-bd02-e62421f0710f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:07.579590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cc953145-05ce-4cf1-bd02-e62421f0710f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:07.580402 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cc953145-05ce-4cf1-bd02-e62421f0710f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:07.580847 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-cc953145-05ce-4cf1-bd02-e62421f0710f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:07.710587 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-cc953145-05ce-4cf1-bd02-e62421f0710f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:07.719435 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-cc953145-05ce-4cf1-bd02-e62421f0710f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1714 microversion: 2.1 time: 0.151500 Aug 02 21:46:07.720076 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 303/579] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:07 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:07.832008 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:07.832551 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:07.838956 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:07.839411 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:07.840208 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:07.840656 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:07.971258 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] HTTP exception thrown: Cannot 'detach_volume' instance 3a9e4798-b622-408c-badf-10489a6cc310 while it is in vm_state rescued Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Request method failure captured: Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: DELETE /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments/a4ed1db7-6ecb-4fc5-83e4-29e8e554891e HTTP/1.1 Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6ZojLJbT9egEuZ8DBMGJ-XCKy-RVgSsX5Owqz-9MyiQob2d6kzqcQN2c30OKBc5PmkGknR8KsxNmw1Pz3neJWOfjR480RI1jW--uB9XwgzYzFYNwgbENme-j3Uzt7HcmMxD3f42lQJJ3XL9SA9jWOgU-EDdAyh64H0xzo83X2oh-3GA Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:46:07.972923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ad2873976b194c2daf265f84f5e60519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: c9f838395a2247e49e0acacd0fdadb2b Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:46:07.974445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Cannot 'detach_volume' instance 3a9e4798-b622-408c-badf-10489a6cc310 while it is in vm_state rescued Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'server_id': '3a9e4798-b622-408c-badf-10489a6cc310', 'id': 'a4ed1db7-6ecb-4fc5-83e4-29e8e554891e'} Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3a9e4798-b622-408c-badf-10489a6cc310 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:46:07.975172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3a9e4798-b622-408c-badf-10489a6cc310 while it is in vm_state rescued Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3a9e4798-b622-408c-badf-10489a6cc310 while it is in vm_state rescued Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:07.976732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Returning 409 to user: Cannot 'detach_volume' instance 3a9e4798-b622-408c-badf-10489a6cc310 while it is in vm_state rescued {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:46:07.978307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9d21463f-434b-4867-8656-23e8510b21e9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments/a4ed1db7-6ecb-4fc5-83e4-29e8e554891e" status: 409 len: 152 microversion: 2.1 time: 0.146490 Aug 02 21:46:07.978307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 277/580] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:46:07 2022] DELETE /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments/a4ed1db7-6ecb-4fc5-83e4-29e8e554891e => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 21:46:07.984544 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9c5c7a7f-0f76-4e8b-b48e-86116f93ee9f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:07.985121 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9c5c7a7f-0f76-4e8b-b48e-86116f93ee9f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:07.991083 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c5c7a7f-0f76-4e8b-b48e-86116f93ee9f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:07.991547 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c5c7a7f-0f76-4e8b-b48e-86116f93ee9f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:07.992434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c5c7a7f-0f76-4e8b-b48e-86116f93ee9f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:07.992878 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c5c7a7f-0f76-4e8b-b48e-86116f93ee9f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:08.065546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9c5c7a7f-0f76-4e8b-b48e-86116f93ee9f tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "POST /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/action" status: 202 len: 0 microversion: 2.1 time: 0.085454 Aug 02 21:46:08.066269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 304/581] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:46:07 2022] POST /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:46:08.075054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ae4272ea-e92d-48e9-b3a0-1005509335c4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:08.075675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ae4272ea-e92d-48e9-b3a0-1005509335c4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:08.083283 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae4272ea-e92d-48e9-b3a0-1005509335c4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:08.083912 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae4272ea-e92d-48e9-b3a0-1005509335c4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:08.084808 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae4272ea-e92d-48e9-b3a0-1005509335c4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:08.085799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae4272ea-e92d-48e9-b3a0-1005509335c4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:08.300794 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ae4272ea-e92d-48e9-b3a0-1005509335c4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:08.309113 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ae4272ea-e92d-48e9-b3a0-1005509335c4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1722 microversion: 2.1 time: 0.238021 Aug 02 21:46:08.309969 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 278/582] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:08 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:09.332413 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-16c67861-4683-47f4-bc9d-873b1f373f36 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:09.333101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-16c67861-4683-47f4-bc9d-873b1f373f36 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:09.339220 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16c67861-4683-47f4-bc9d-873b1f373f36 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:09.339668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16c67861-4683-47f4-bc9d-873b1f373f36 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:09.340450 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16c67861-4683-47f4-bc9d-873b1f373f36 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:09.340884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16c67861-4683-47f4-bc9d-873b1f373f36 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:09.467376 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-16c67861-4683-47f4-bc9d-873b1f373f36 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:09.477717 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-16c67861-4683-47f4-bc9d-873b1f373f36 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1722 microversion: 2.1 time: 0.150097 Aug 02 21:46:09.478298 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 305/583] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:09 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:10.498807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e73ea3be-413d-4214-ac1e-4385250cd712 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:10.499417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e73ea3be-413d-4214-ac1e-4385250cd712 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:10.505932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e73ea3be-413d-4214-ac1e-4385250cd712 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:10.506381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e73ea3be-413d-4214-ac1e-4385250cd712 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:10.507146 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e73ea3be-413d-4214-ac1e-4385250cd712 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:10.507586 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e73ea3be-413d-4214-ac1e-4385250cd712 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:10.635596 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e73ea3be-413d-4214-ac1e-4385250cd712 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:10.643519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e73ea3be-413d-4214-ac1e-4385250cd712 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1722 microversion: 2.1 time: 0.148635 Aug 02 21:46:10.644075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 279/584] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:10 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:11.665681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-56ccc03e-80c3-4ed7-84be-05db0d95e2e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:11.666324 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-56ccc03e-80c3-4ed7-84be-05db0d95e2e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:11.673498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-56ccc03e-80c3-4ed7-84be-05db0d95e2e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:11.673998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-56ccc03e-80c3-4ed7-84be-05db0d95e2e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:11.674798 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-56ccc03e-80c3-4ed7-84be-05db0d95e2e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:11.675246 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-56ccc03e-80c3-4ed7-84be-05db0d95e2e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:11.803939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-56ccc03e-80c3-4ed7-84be-05db0d95e2e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:11.811978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-56ccc03e-80c3-4ed7-84be-05db0d95e2e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1722 microversion: 2.1 time: 0.150353 Aug 02 21:46:11.812575 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 306/585] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:11 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:12.833421 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-19056b97-74e2-4059-8445-e33afff3a5e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:12.834042 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-19056b97-74e2-4059-8445-e33afff3a5e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:12.840592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19056b97-74e2-4059-8445-e33afff3a5e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:12.841056 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19056b97-74e2-4059-8445-e33afff3a5e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:12.841830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19056b97-74e2-4059-8445-e33afff3a5e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:12.842273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19056b97-74e2-4059-8445-e33afff3a5e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:12.971883 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-19056b97-74e2-4059-8445-e33afff3a5e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:12.979882 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-19056b97-74e2-4059-8445-e33afff3a5e1 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1728 microversion: 2.1 time: 0.150413 Aug 02 21:46:12.980479 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 280/586] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:12 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:13.005268 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-522c6428-037d-4b52-8b2d-cc9beec30c7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:13.005786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-522c6428-037d-4b52-8b2d-cc9beec30c7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:13.012416 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-522c6428-037d-4b52-8b2d-cc9beec30c7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:13.012868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-522c6428-037d-4b52-8b2d-cc9beec30c7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:13.013629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-522c6428-037d-4b52-8b2d-cc9beec30c7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:13.014085 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-522c6428-037d-4b52-8b2d-cc9beec30c7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:13.093658 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-522c6428-037d-4b52-8b2d-cc9beec30c7b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092224 Aug 02 21:46:13.094239 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 307/587] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 2 21:46:13 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:14.032546 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-cc7ff3df-dc9c-4126-af2d-127fe329070a req-64ec5114-ce00-4148-9cc4-fe6a46b223bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9e4798-b622-408c-badf-10489a6cc310", "tag": "a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:14.042043 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-cc7ff3df-dc9c-4126-af2d-127fe329070a req-64ec5114-ce00-4148-9cc4-fe6a46b223bf service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:14.042520 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-cc7ff3df-dc9c-4126-af2d-127fe329070a req-64ec5114-ce00-4148-9cc4-fe6a46b223bf service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:14.053766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-cc7ff3df-dc9c-4126-af2d-127fe329070a req-64ec5114-ce00-4148-9cc4-fe6a46b223bf service nova] Creating event network-changed:a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f for instance 3a9e4798-b622-408c-badf-10489a6cc310 on hv-cinder-85144 Aug 02 21:46:14.058909 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-cc7ff3df-dc9c-4126-af2d-127fe329070a req-64ec5114-ce00-4148-9cc4-fe6a46b223bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094039 Aug 02 21:46:14.059500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 281/588] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:16.073685 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-824ae2a2-f43a-414d-8f18-0c7fa87df454 req-97a54271-9adf-4e02-881c-f04f973a1fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9e4798-b622-408c-badf-10489a6cc310", "tag": "a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:16.082844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-824ae2a2-f43a-414d-8f18-0c7fa87df454 req-97a54271-9adf-4e02-881c-f04f973a1fcc service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:16.083282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-824ae2a2-f43a-414d-8f18-0c7fa87df454 req-97a54271-9adf-4e02-881c-f04f973a1fcc service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:16.094624 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-824ae2a2-f43a-414d-8f18-0c7fa87df454 req-97a54271-9adf-4e02-881c-f04f973a1fcc service nova] Creating event network-changed:a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f for instance 3a9e4798-b622-408c-badf-10489a6cc310 on hv-cinder-85144 Aug 02 21:46:16.099460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-824ae2a2-f43a-414d-8f18-0c7fa87df454 req-97a54271-9adf-4e02-881c-f04f973a1fcc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029866 Aug 02 21:46:16.100018 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 308/589] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:23.658375 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-66b26b32-9a3b-4ba8-9e9f-b26b801e58ed tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:23.658965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-66b26b32-9a3b-4ba8-9e9f-b26b801e58ed tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:23.660927 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=27 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:23.666575 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66b26b32-9a3b-4ba8-9e9f-b26b801e58ed tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:23.667027 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66b26b32-9a3b-4ba8-9e9f-b26b801e58ed tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:23.667794 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66b26b32-9a3b-4ba8-9e9f-b26b801e58ed tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:23.668259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66b26b32-9a3b-4ba8-9e9f-b26b801e58ed tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:23.672654 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:23.749306 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-66b26b32-9a3b-4ba8-9e9f-b26b801e58ed tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lazy-loading 'services' on Instance uuid 29658748-1966-42f3-9fec-c72df8ee883d {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:46:23.863364 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-66b26b32-9a3b-4ba8-9e9f-b26b801e58ed tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/os-volume_attachments/8c1b1368-bbea-470a-8506-fa8fd0a292bb" status: 202 len: 0 microversion: 2.1 time: 0.306356 Aug 02 21:46:23.864156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 282/590] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:46:23 2022] DELETE /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/os-volume_attachments/8c1b1368-bbea-470a-8506-fa8fd0a292bb => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:46:25.687771 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c5ee679c-ace7-4a0f-9b63-780758ecb536 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:25.688475 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c5ee679c-ace7-4a0f-9b63-780758ecb536 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:25.690437 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=27 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:25.696124 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c5ee679c-ace7-4a0f-9b63-780758ecb536 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:25.696613 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c5ee679c-ace7-4a0f-9b63-780758ecb536 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:25.697389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c5ee679c-ace7-4a0f-9b63-780758ecb536 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:25.697831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c5ee679c-ace7-4a0f-9b63-780758ecb536 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:25.700438 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:25.725738 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c5ee679c-ace7-4a0f-9b63-780758ecb536 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025/ips" status: 200 len: 149 microversion: 2.1 time: 0.138479 Aug 02 21:46:25.726292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 309/591] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:46:25 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025/ips => generated 149 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:25.738789 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ee4dcfc-220e-436b-87f8-4fa8fe61197b"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:25.741226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:25.749853 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:25.750705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:25.752093 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:25.752980 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:25.833334 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Invalid volume: volume 9ee4dcfc-220e-436b-87f8-4fa8fe61197b is already attached to instances: ffdc7be9-6b66-4157-8533-c7fedcee85cd Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: POST /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025/os-volume_attachments HTTP/1.1 Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 74 Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:46:25.835068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {"volumeAttachment": {"volumeId": "9ee4dcfc-220e-436b-87f8-4fa8fe61197b"}} Aug 02 21:46:25.836532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Invalid volume: volume 9ee4dcfc-220e-436b-87f8-4fa8fe61197b is already attached to instances: ffdc7be9-6b66-4157-8533-c7fedcee85cd Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'server_id': 'f3a43570-a3a3-44b3-80c6-dc192cc97025', 'body': {'volumeAttachment': {'volumeId': '9ee4dcfc-220e-436b-87f8-4fa8fe61197b'}}} Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9ee4dcfc-220e-436b-87f8-4fa8fe61197b is already attached to instances: ffdc7be9-6b66-4157-8533-c7fedcee85cd Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:25.837390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9ee4dcfc-220e-436b-87f8-4fa8fe61197b is already attached to instances: ffdc7be9-6b66-4157-8533-c7fedcee85cd Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:25.838518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:25.839640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:25.839640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:46:25.839640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:46:25.839640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9ee4dcfc-220e-436b-87f8-4fa8fe61197b is already attached to instances: ffdc7be9-6b66-4157-8533-c7fedcee85cd Aug 02 21:46:25.839640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:25.839640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 400 to user: Invalid volume: volume 9ee4dcfc-220e-436b-87f8-4fa8fe61197b is already attached to instances: ffdc7be9-6b66-4157-8533-c7fedcee85cd {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:46:25.839640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-95e25276-b97a-4cac-9ebe-ef14499a7a00 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102143 Aug 02 21:46:25.839640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 283/592] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:46:25 2022] POST /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 21:46:25.846461 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-760d7e92-e1d6-4849-b8d4-38e6df127933 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:25.846902 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-760d7e92-e1d6-4849-b8d4-38e6df127933 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:25.852975 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-760d7e92-e1d6-4849-b8d4-38e6df127933 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:25.853561 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-760d7e92-e1d6-4849-b8d4-38e6df127933 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:25.854179 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-760d7e92-e1d6-4849-b8d4-38e6df127933 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:25.854614 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-760d7e92-e1d6-4849-b8d4-38e6df127933 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:25.878705 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-760d7e92-e1d6-4849-b8d4-38e6df127933 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:46:25.960119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-760d7e92-e1d6-4849-b8d4-38e6df127933 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 204 len: 0 microversion: 2.1 time: 0.117111 Aug 02 21:46:25.960744 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 310/593] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:46:25 2022] DELETE /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:46:25.969886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c314cb96-3299-416f-96d2-9e220d396e64 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:25.970628 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c314cb96-3299-416f-96d2-9e220d396e64 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:25.977296 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c314cb96-3299-416f-96d2-9e220d396e64 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:25.977785 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c314cb96-3299-416f-96d2-9e220d396e64 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:25.978558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c314cb96-3299-416f-96d2-9e220d396e64 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:25.979003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c314cb96-3299-416f-96d2-9e220d396e64 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:26.046687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a86f14ed-392d-4425-b622-6898dac2c960 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:26.053089 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a86f14ed-392d-4425-b622-6898dac2c960 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:26.053615 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a86f14ed-392d-4425-b622-6898dac2c960 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:26.076569 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a86f14ed-392d-4425-b622-6898dac2c960 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Going to try to stop instance {{(pid=124839) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 21:46:26.110122 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c314cb96-3299-416f-96d2-9e220d396e64 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:26.118038 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c314cb96-3299-416f-96d2-9e220d396e64 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1682 microversion: 2.1 time: 0.152645 Aug 02 21:46:26.129368 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 284/594] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:25 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:46:26.129607 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a86f14ed-392d-4425-b622-6898dac2c960 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/action" status: 202 len: 0 microversion: 2.1 time: 0.077467 Aug 02 21:46:26.129607 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 311/595] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:46:26 2022] POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 21:46:26.129782 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-371a0fe8-e9b4-4f19-9b6c-a7df33a0a543 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:26.129782 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-371a0fe8-e9b4-4f19-9b6c-a7df33a0a543 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:26.135220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-371a0fe8-e9b4-4f19-9b6c-a7df33a0a543 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:26.135674 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-371a0fe8-e9b4-4f19-9b6c-a7df33a0a543 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:26.136478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-371a0fe8-e9b4-4f19-9b6c-a7df33a0a543 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:26.136917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-371a0fe8-e9b4-4f19-9b6c-a7df33a0a543 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:26.267243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-371a0fe8-e9b4-4f19-9b6c-a7df33a0a543 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:26.275191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-371a0fe8-e9b4-4f19-9b6c-a7df33a0a543 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.150394 Aug 02 21:46:26.275763 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 285/596] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:26 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:27.140015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-83270e3d-8527-4f84-87c5-bfc758298d48 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:27.140669 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-83270e3d-8527-4f84-87c5-bfc758298d48 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:27.147557 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83270e3d-8527-4f84-87c5-bfc758298d48 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:27.148015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83270e3d-8527-4f84-87c5-bfc758298d48 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:27.148813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83270e3d-8527-4f84-87c5-bfc758298d48 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:27.149258 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83270e3d-8527-4f84-87c5-bfc758298d48 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:27.282495 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-83270e3d-8527-4f84-87c5-bfc758298d48 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:27.290077 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-83270e3d-8527-4f84-87c5-bfc758298d48 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1682 microversion: 2.1 time: 0.154965 Aug 02 21:46:27.290643 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 312/597] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:27 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:27.296651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-323b9fd9-99bd-4dfb-ab49-842867df31fd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:27.297291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-323b9fd9-99bd-4dfb-ab49-842867df31fd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:27.303604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-323b9fd9-99bd-4dfb-ab49-842867df31fd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:27.304056 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-323b9fd9-99bd-4dfb-ab49-842867df31fd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:27.304845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-323b9fd9-99bd-4dfb-ab49-842867df31fd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:27.305279 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-323b9fd9-99bd-4dfb-ab49-842867df31fd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:27.430315 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-323b9fd9-99bd-4dfb-ab49-842867df31fd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:27.438265 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-323b9fd9-99bd-4dfb-ab49-842867df31fd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.145414 Aug 02 21:46:27.438862 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 286/598] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:27 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:28.311151 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-772c05b2-670d-4e13-a822-c82175338600 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:28.311754 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-772c05b2-670d-4e13-a822-c82175338600 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:28.318162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-772c05b2-670d-4e13-a822-c82175338600 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:28.318617 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-772c05b2-670d-4e13-a822-c82175338600 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:28.319392 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-772c05b2-670d-4e13-a822-c82175338600 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:28.319830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-772c05b2-670d-4e13-a822-c82175338600 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:28.462783 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-772c05b2-670d-4e13-a822-c82175338600 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:28.465589 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-beb0a6a1-29a1-420f-891e-5a61c2a3fd21 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:28.472059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-beb0a6a1-29a1-420f-891e-5a61c2a3fd21 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:28.478583 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-772c05b2-670d-4e13-a822-c82175338600 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 200 len: 1682 microversion: 2.1 time: 0.171300 Aug 02 21:46:28.479380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 313/599] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:28 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:28.485641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-beb0a6a1-29a1-420f-891e-5a61c2a3fd21 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:28.486105 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-beb0a6a1-29a1-420f-891e-5a61c2a3fd21 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:28.486919 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-beb0a6a1-29a1-420f-891e-5a61c2a3fd21 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:28.487357 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-beb0a6a1-29a1-420f-891e-5a61c2a3fd21 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:28.675550 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-beb0a6a1-29a1-420f-891e-5a61c2a3fd21 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:28.683451 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-beb0a6a1-29a1-420f-891e-5a61c2a3fd21 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.225945 Aug 02 21:46:28.684169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 287/600] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:28 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:28.884553 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-b2044504-2b71-4f43-bd5f-ad1bb4cc921d req-dd39b7bd-f339-477a-874f-f029fd0ca7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a43570-a3a3-44b3-80c6-dc192cc97025", "name": "network-vif-deleted", "tag": "ca6af77c-db43-4a8d-9e66-2f05cfd88f76"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:28.895951 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-b2044504-2b71-4f43-bd5f-ad1bb4cc921d req-dd39b7bd-f339-477a-874f-f029fd0ca7c1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:28.896782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-b2044504-2b71-4f43-bd5f-ad1bb4cc921d req-dd39b7bd-f339-477a-874f-f029fd0ca7c1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:28.909555 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-b2044504-2b71-4f43-bd5f-ad1bb4cc921d req-dd39b7bd-f339-477a-874f-f029fd0ca7c1 service nova] Creating event network-vif-deleted:ca6af77c-db43-4a8d-9e66-2f05cfd88f76 for instance f3a43570-a3a3-44b3-80c6-dc192cc97025 on hv-cinder-85144 Aug 02 21:46:28.915341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-b2044504-2b71-4f43-bd5f-ad1bb4cc921d req-dd39b7bd-f339-477a-874f-f029fd0ca7c1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093647 Aug 02 21:46:28.917395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 314/601] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:29.504734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:29.505602 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:29.512525 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:29.513019 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:29.514393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:29.515080 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:29.531316 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 HTTP/1.1 Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:46:29.532863 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:46:29.534065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'f3a43570-a3a3-44b3-80c6-dc192cc97025'} Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:46:29.534775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:46:29.535915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:46:29.538730 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:46:29.538730 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f4c55285-182e-4a2d-9d02-c411a1ea0385 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 404 len: 111 microversion: 2.1 time: 0.033514 Aug 02 21:46:29.538730 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 288/602] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:29 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:46:29.544113 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0aa19da0-5825-4bc2-9f84-46583b595003 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '.version_select at 0x7ff552f460d0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:29.569717 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0aa19da0-5825-4bc2-9f84-46583b595003 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689058455" status: 202 len: 0 microversion: 2.1 time: 0.030120 Aug 02 21:46:29.570637 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 315/603] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 2 21:46:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689058455 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 21:46:29.708851 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-599e44d7-92a7-4996-ac12-d22ee662a78a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:29.710671 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-599e44d7-92a7-4996-ac12-d22ee662a78a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:29.721254 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-599e44d7-92a7-4996-ac12-d22ee662a78a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:29.721890 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-599e44d7-92a7-4996-ac12-d22ee662a78a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:29.728651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-599e44d7-92a7-4996-ac12-d22ee662a78a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:29.731627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-599e44d7-92a7-4996-ac12-d22ee662a78a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:30.266510 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-599e44d7-92a7-4996-ac12-d22ee662a78a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:30.274460 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-599e44d7-92a7-4996-ac12-d22ee662a78a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.572956 Aug 02 21:46:30.275020 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 289/604] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:29 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:30.598505 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c95d5b52-e3c3-4ca3-ad8c-1ab9b3cae702 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:30.599131 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c95d5b52-e3c3-4ca3-ad8c-1ab9b3cae702 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:30.605743 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c95d5b52-e3c3-4ca3-ad8c-1ab9b3cae702 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:30.606201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c95d5b52-e3c3-4ca3-ad8c-1ab9b3cae702 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:30.607034 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c95d5b52-e3c3-4ca3-ad8c-1ab9b3cae702 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:30.607475 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c95d5b52-e3c3-4ca3-ad8c-1ab9b3cae702 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:30.729654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-c95d5b52-e3c3-4ca3-ad8c-1ab9b3cae702 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lazy-loading 'services' on Instance uuid ffdc7be9-6b66-4157-8533-c7fedcee85cd {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:46:30.845959 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c95d5b52-e3c3-4ca3-ad8c-1ab9b3cae702 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-volume_attachments/9ee4dcfc-220e-436b-87f8-4fa8fe61197b" status: 202 len: 0 microversion: 2.1 time: 0.251647 Aug 02 21:46:30.846561 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 316/605] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:46:30 2022] DELETE /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-volume_attachments/9ee4dcfc-220e-436b-87f8-4fa8fe61197b => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:46:30.857486 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3c2d4b5d-0f21-4a89-b36d-fdc2f67fb2f0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:30.860824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3c2d4b5d-0f21-4a89-b36d-fdc2f67fb2f0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:30.869535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b5d-0f21-4a89-b36d-fdc2f67fb2f0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:30.869983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b5d-0f21-4a89-b36d-fdc2f67fb2f0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:30.870763 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b5d-0f21-4a89-b36d-fdc2f67fb2f0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:30.871196 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b5d-0f21-4a89-b36d-fdc2f67fb2f0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:30.902931 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3c2d4b5d-0f21-4a89-b36d-fdc2f67fb2f0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051264 Aug 02 21:46:30.904329 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 290/606] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:46:30 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:31.296823 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-06a971c9-22b4-471b-9cd7-5825596c4494 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:31.297532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-06a971c9-22b4-471b-9cd7-5825596c4494 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:31.303971 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-06a971c9-22b4-471b-9cd7-5825596c4494 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:31.304493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-06a971c9-22b4-471b-9cd7-5825596c4494 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:31.305300 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-06a971c9-22b4-471b-9cd7-5825596c4494 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:31.305745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-06a971c9-22b4-471b-9cd7-5825596c4494 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:31.438097 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-06a971c9-22b4-471b-9cd7-5825596c4494 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:31.446308 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-06a971c9-22b4-471b-9cd7-5825596c4494 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.153782 Aug 02 21:46:31.447422 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 317/607] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:31 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:31.916143 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-655865ae-101a-4595-95a2-871710b4b93d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:31.918311 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-655865ae-101a-4595-95a2-871710b4b93d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:31.924780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-655865ae-101a-4595-95a2-871710b4b93d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:31.925227 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-655865ae-101a-4595-95a2-871710b4b93d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:31.925986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-655865ae-101a-4595-95a2-871710b4b93d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:31.926415 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-655865ae-101a-4595-95a2-871710b4b93d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:31.955973 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-655865ae-101a-4595-95a2-871710b4b93d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043852 Aug 02 21:46:31.956570 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 291/608] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:46:31 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:46:32.016803 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-554bddc6-8930-4ca0-8c90-8efd8d5a7499 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:32.017343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-554bddc6-8930-4ca0-8c90-8efd8d5a7499 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:32.024590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-554bddc6-8930-4ca0-8c90-8efd8d5a7499 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:32.025047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-554bddc6-8930-4ca0-8c90-8efd8d5a7499 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:32.025855 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-554bddc6-8930-4ca0-8c90-8efd8d5a7499 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:32.026414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-554bddc6-8930-4ca0-8c90-8efd8d5a7499 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:32.051496 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-554bddc6-8930-4ca0-8c90-8efd8d5a7499 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:46:32.129062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-554bddc6-8930-4ca0-8c90-8efd8d5a7499 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 204 len: 0 microversion: 2.1 time: 0.115681 Aug 02 21:46:32.129660 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 318/609] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:46:32 2022] DELETE /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:46:32.137970 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ab04cb21-5c89-4971-b08b-bf9e2d48cd95 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:32.138579 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ab04cb21-5c89-4971-b08b-bf9e2d48cd95 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:32.144515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab04cb21-5c89-4971-b08b-bf9e2d48cd95 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:32.145216 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab04cb21-5c89-4971-b08b-bf9e2d48cd95 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:32.145969 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab04cb21-5c89-4971-b08b-bf9e2d48cd95 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:32.146399 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab04cb21-5c89-4971-b08b-bf9e2d48cd95 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:32.274118 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ab04cb21-5c89-4971-b08b-bf9e2d48cd95 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:32.281666 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ab04cb21-5c89-4971-b08b-bf9e2d48cd95 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1680 microversion: 2.1 time: 0.147487 Aug 02 21:46:32.282198 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 292/610] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:32 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:46:32.469408 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7686490f-93e2-4f25-bcab-c96a168b654d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:32.470077 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7686490f-93e2-4f25-bcab-c96a168b654d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:32.476097 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7686490f-93e2-4f25-bcab-c96a168b654d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:32.476611 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7686490f-93e2-4f25-bcab-c96a168b654d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:32.477385 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7686490f-93e2-4f25-bcab-c96a168b654d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:32.477833 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7686490f-93e2-4f25-bcab-c96a168b654d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:32.611211 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7686490f-93e2-4f25-bcab-c96a168b654d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:32.619460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7686490f-93e2-4f25-bcab-c96a168b654d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.154734 Aug 02 21:46:32.620123 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 319/611] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:32 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:33.303005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e7b3d902-0e23-4c73-939c-4921ced1a524 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:33.303648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e7b3d902-0e23-4c73-939c-4921ced1a524 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:33.310324 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e7b3d902-0e23-4c73-939c-4921ced1a524 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:33.310780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e7b3d902-0e23-4c73-939c-4921ced1a524 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:33.311552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e7b3d902-0e23-4c73-939c-4921ced1a524 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:33.311991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e7b3d902-0e23-4c73-939c-4921ced1a524 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:33.553346 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e7b3d902-0e23-4c73-939c-4921ced1a524 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:33.561178 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e7b3d902-0e23-4c73-939c-4921ced1a524 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1680 microversion: 2.1 time: 0.262162 Aug 02 21:46:33.561763 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 293/612] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:33 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:33.640315 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-988d3eb8-8f97-42a9-a467-ad3442cc9762 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:33.641008 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-988d3eb8-8f97-42a9-a467-ad3442cc9762 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:33.647391 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-988d3eb8-8f97-42a9-a467-ad3442cc9762 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:33.647863 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-988d3eb8-8f97-42a9-a467-ad3442cc9762 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:33.648666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-988d3eb8-8f97-42a9-a467-ad3442cc9762 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:33.649109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-988d3eb8-8f97-42a9-a467-ad3442cc9762 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:33.785485 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-988d3eb8-8f97-42a9-a467-ad3442cc9762 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:33.793350 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-988d3eb8-8f97-42a9-a467-ad3442cc9762 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.157396 Aug 02 21:46:33.793914 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 320/613] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:33 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:34.009991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-e9a3dc68-a941-4275-9bd9-0e1b17c05529 req-bec63804-aeb5-4501-bc88-7dd863cfee24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffdc7be9-6b66-4157-8533-c7fedcee85cd", "name": "network-vif-deleted", "tag": "e78e48c5-9b03-4f00-86f4-4b6796ab3b28"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:34.020822 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-e9a3dc68-a941-4275-9bd9-0e1b17c05529 req-bec63804-aeb5-4501-bc88-7dd863cfee24 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:34.021361 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-e9a3dc68-a941-4275-9bd9-0e1b17c05529 req-bec63804-aeb5-4501-bc88-7dd863cfee24 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:34.032648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-e9a3dc68-a941-4275-9bd9-0e1b17c05529 req-bec63804-aeb5-4501-bc88-7dd863cfee24 service nova] Creating event network-vif-deleted:e78e48c5-9b03-4f00-86f4-4b6796ab3b28 for instance ffdc7be9-6b66-4157-8533-c7fedcee85cd on hv-cinder-85144 Aug 02 21:46:34.038188 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-e9a3dc68-a941-4275-9bd9-0e1b17c05529 req-bec63804-aeb5-4501-bc88-7dd863cfee24 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031940 Aug 02 21:46:34.039096 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 294/614] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:34.582945 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:34.583678 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:34.590643 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:34.591845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:34.592852 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:34.593296 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:34.628621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:34.629067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:34.629614 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lazy-loading 'fault' on Instance uuid ffdc7be9-6b66-4157-8533-c7fedcee85cd {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:46:34.678177 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:34.686401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9022c614-ae99-49de-bb1f-e349c73491b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 200 len: 1330 microversion: 2.1 time: 0.107284 Aug 02 21:46:34.687056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 321/615] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:34 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:34.815816 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e9870823-8147-4816-998b-7c5c747a19e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:34.816561 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e9870823-8147-4816-998b-7c5c747a19e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:34.822803 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e9870823-8147-4816-998b-7c5c747a19e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:34.823250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e9870823-8147-4816-998b-7c5c747a19e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:34.824002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e9870823-8147-4816-998b-7c5c747a19e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:34.824458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e9870823-8147-4816-998b-7c5c747a19e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:34.961713 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e9870823-8147-4816-998b-7c5c747a19e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:34.969374 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e9870823-8147-4816-998b-7c5c747a19e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.158294 Aug 02 21:46:34.969946 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 295/616] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:34 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:35.707342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:35.707964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:35.715403 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:35.715863 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:35.716681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:35.717127 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:35.729891 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd HTTP/1.1 Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:46:35.732015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:46:35.733663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'ffdc7be9-6b66-4157-8533-c7fedcee85cd'} Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:46:35.734546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:46:35.736287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:35.737787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:46:35.737787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-35b0b345-ec92-4071-b7ff-c436944642c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 404 len: 111 microversion: 2.1 time: 0.029964 Aug 02 21:46:35.737787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 322/617] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:35 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:46:35.742214 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-25a69f9f-f2eb-4269-b42a-17ace221a34f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '.version_select at 0x7ff552f1d040>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:35.762573 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-25a69f9f-f2eb-4269-b42a-17ace221a34f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598388876" status: 202 len: 0 microversion: 2.1 time: 0.024139 Aug 02 21:46:35.763348 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 296/618] 10.222.0.57 () {58 vars in 1218 bytes} [Tue Aug 2 21:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598388876 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:46:35.991005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-68368ff4-0b0a-4579-bcc0-12daa5d6b014 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:35.991628 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-68368ff4-0b0a-4579-bcc0-12daa5d6b014 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:35.998694 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-68368ff4-0b0a-4579-bcc0-12daa5d6b014 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:35.999221 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-68368ff4-0b0a-4579-bcc0-12daa5d6b014 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:36.000074 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-68368ff4-0b0a-4579-bcc0-12daa5d6b014 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:36.000631 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-68368ff4-0b0a-4579-bcc0-12daa5d6b014 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:36.004903 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:36.212767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-68368ff4-0b0a-4579-bcc0-12daa5d6b014 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:36.220439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-68368ff4-0b0a-4579-bcc0-12daa5d6b014 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.233211 Aug 02 21:46:36.221012 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 323/619] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:35 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:36.426618 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ba088b07-6a4a-4d2f-b963-43b8f8440d28 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: .version_select at 0x7ff552e27430>, body: {"keypair": {"name": "tempest-keypair-1433383095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5hZu0TGYYiDpRgofo1UzGdPCisLgCTLnv8tyKFHxNkeUdSCA1YSnCBXLC77yJDlk/3X3PUZajbKd5yi21YjEQ3HHLdqIobWPsN8oj7HpoJmdPAZuK9Z/pru55ZiQIDQw=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:36.443002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-ba088b07-6a4a-4d2f-b963-43b8f8440d28 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for project c63bab062a6e4225a462ac0265535d16. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:46:36.446888 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-ba088b07-6a4a-4d2f-b963-43b8f8440d28 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for user e477f5953a534355b29c071086846ff6 and project c63bab062a6e4225a462ac0265535d16. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:46:36.468797 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ba088b07-6a4a-4d2f-b963-43b8f8440d28 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046631 Aug 02 21:46:36.469376 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 297/620] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:46:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:37.241857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4f954d52-cf25-4963-95dc-c9dccfde5f11 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:37.242453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4f954d52-cf25-4963-95dc-c9dccfde5f11 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:37.249847 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4f954d52-cf25-4963-95dc-c9dccfde5f11 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:37.250298 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4f954d52-cf25-4963-95dc-c9dccfde5f11 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:37.251075 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4f954d52-cf25-4963-95dc-c9dccfde5f11 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:37.251509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4f954d52-cf25-4963-95dc-c9dccfde5f11 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:37.384865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4f954d52-cf25-4963-95dc-c9dccfde5f11 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:37.392417 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4f954d52-cf25-4963-95dc-c9dccfde5f11 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.154457 Aug 02 21:46:37.393080 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 324/621] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:37 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:37.681321 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-12185655", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d6d25b-0453-4cac-840b-702ab041b963"}], "security_groups": [{"name": "tempest-securitygroup--810245193"}], "key_name": "tempest-keypair-1433383095", "user_data": "}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:37.784269 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] validate_networks() for [('93d6d25b-0453-4cac-840b-702ab041b963', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:46:38.193794 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:46:38.194256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:46:38.194769 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:46:38.195184 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:46:38.195604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:46:38.204459 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:38.204917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:38.205720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:38.206164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:38.222480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for project c63bab062a6e4225a462ac0265535d16. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:46:38.226463 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for user e477f5953a534355b29c071086846ff6 and project c63bab062a6e4225a462ac0265535d16. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:46:38.238024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:46:38.240309 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:46:38.284491 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [705f3289-eea2-452e-9716-08b9b2981250] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 21:46:38.413571 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a2cab3a4-7ba0-4490-bf97-156646ec1606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:38.414195 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a2cab3a4-7ba0-4490-bf97-156646ec1606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:38.420685 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a2cab3a4-7ba0-4490-bf97-156646ec1606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:38.421145 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a2cab3a4-7ba0-4490-bf97-156646ec1606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:38.421923 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a2cab3a4-7ba0-4490-bf97-156646ec1606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:38.422366 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a2cab3a4-7ba0-4490-bf97-156646ec1606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:38.559106 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a2cab3a4-7ba0-4490-bf97-156646ec1606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:38.571500 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a2cab3a4-7ba0-4490-bf97-156646ec1606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.159425 Aug 02 21:46:38.572092 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 325/622] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:38 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:46:39.293358 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [705f3289-eea2-452e-9716-08b9b2981250] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 43194. Aug 02 21:46:39.297562 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7a465b23-79f5-4f94-b924-9fa84395f911 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.621067 Aug 02 21:46:39.298214 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 298/623] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:46:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:46:39.310556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-109aefed-7471-4138-be75-984243e736e7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:39.311182 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-109aefed-7471-4138-be75-984243e736e7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:39.367592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-109aefed-7471-4138-be75-984243e736e7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:39.374967 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-109aefed-7471-4138-be75-984243e736e7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1240 microversion: 2.1 time: 0.069316 Aug 02 21:46:39.375532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 326/624] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:39 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:46:39.602358 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4e34b19a-e28b-4188-b6d9-55c498ab0e28 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:39.602982 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4e34b19a-e28b-4188-b6d9-55c498ab0e28 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:39.610287 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4e34b19a-e28b-4188-b6d9-55c498ab0e28 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:39.610748 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4e34b19a-e28b-4188-b6d9-55c498ab0e28 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:39.611522 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4e34b19a-e28b-4188-b6d9-55c498ab0e28 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:39.611963 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4e34b19a-e28b-4188-b6d9-55c498ab0e28 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:39.755955 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4e34b19a-e28b-4188-b6d9-55c498ab0e28 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:39.764418 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4e34b19a-e28b-4188-b6d9-55c498ab0e28 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.166022 Aug 02 21:46:39.765457 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 299/625] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:39 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:40.397502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-86416131-fd5c-45f1-8a1a-0569a9e1c703 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:40.398129 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-86416131-fd5c-45f1-8a1a-0569a9e1c703 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:40.406131 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-86416131-fd5c-45f1-8a1a-0569a9e1c703 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:40.406695 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-86416131-fd5c-45f1-8a1a-0569a9e1c703 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:40.407583 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-86416131-fd5c-45f1-8a1a-0569a9e1c703 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:40.408595 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-86416131-fd5c-45f1-8a1a-0569a9e1c703 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:40.473410 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-86416131-fd5c-45f1-8a1a-0569a9e1c703 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:40.481221 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-86416131-fd5c-45f1-8a1a-0569a9e1c703 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1300 microversion: 2.1 time: 0.088660 Aug 02 21:46:40.481788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 327/626] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:40 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:40.786010 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1eabeb3e-f4d8-40bb-93e7-9b8786c10a13 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:40.786643 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1eabeb3e-f4d8-40bb-93e7-9b8786c10a13 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:40.792992 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1eabeb3e-f4d8-40bb-93e7-9b8786c10a13 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:40.793448 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1eabeb3e-f4d8-40bb-93e7-9b8786c10a13 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:40.794246 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1eabeb3e-f4d8-40bb-93e7-9b8786c10a13 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:40.794694 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1eabeb3e-f4d8-40bb-93e7-9b8786c10a13 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:41.018071 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1eabeb3e-f4d8-40bb-93e7-9b8786c10a13 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:41.025756 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1eabeb3e-f4d8-40bb-93e7-9b8786c10a13 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.243669 Aug 02 21:46:41.026332 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 300/627] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:40 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:41.503313 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-dd7b0e10-910e-4121-91e1-9a2efc256feb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:41.504066 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-dd7b0e10-910e-4121-91e1-9a2efc256feb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:41.510498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dd7b0e10-910e-4121-91e1-9a2efc256feb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:41.511234 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dd7b0e10-910e-4121-91e1-9a2efc256feb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:41.512067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dd7b0e10-910e-4121-91e1-9a2efc256feb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:41.513331 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dd7b0e10-910e-4121-91e1-9a2efc256feb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:41.649460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-dd7b0e10-910e-4121-91e1-9a2efc256feb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:41.657641 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-dd7b0e10-910e-4121-91e1-9a2efc256feb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.158081 Aug 02 21:46:41.658216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 328/628] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:41 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:41.920447 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-7b256e6e-7c4d-44ae-900c-6106f3d6c44c req-e7e9a4b9-c87d-4716-a089-e8d08f47b1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935f0f24-4d12-498c-bb68-770aa9ee2210", "tag": "f59aa865-1125-46ab-a52c-dea7421d5460"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:41.931843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-7b256e6e-7c4d-44ae-900c-6106f3d6c44c req-e7e9a4b9-c87d-4716-a089-e8d08f47b1c2 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:41.932473 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-7b256e6e-7c4d-44ae-900c-6106f3d6c44c req-e7e9a4b9-c87d-4716-a089-e8d08f47b1c2 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:41.943564 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-7b256e6e-7c4d-44ae-900c-6106f3d6c44c req-e7e9a4b9-c87d-4716-a089-e8d08f47b1c2 service nova] Creating event network-changed:f59aa865-1125-46ab-a52c-dea7421d5460 for instance 935f0f24-4d12-498c-bb68-770aa9ee2210 on hv-cinder-85144 Aug 02 21:46:41.948328 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-7b256e6e-7c4d-44ae-900c-6106f3d6c44c req-e7e9a4b9-c87d-4716-a089-e8d08f47b1c2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031770 Aug 02 21:46:41.948925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 301/629] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:42.046875 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-36e0cc30-d8bb-4d3d-a6fc-8f278a5050b0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:42.047761 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-36e0cc30-d8bb-4d3d-a6fc-8f278a5050b0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:42.053965 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-36e0cc30-d8bb-4d3d-a6fc-8f278a5050b0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:42.054425 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-36e0cc30-d8bb-4d3d-a6fc-8f278a5050b0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:42.055204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-36e0cc30-d8bb-4d3d-a6fc-8f278a5050b0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:42.055649 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-36e0cc30-d8bb-4d3d-a6fc-8f278a5050b0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:42.185092 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-36e0cc30-d8bb-4d3d-a6fc-8f278a5050b0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:42.193048 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-36e0cc30-d8bb-4d3d-a6fc-8f278a5050b0 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.150161 Aug 02 21:46:42.193623 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 329/630] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:42 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:42.679665 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6425f193-213d-4dd9-8865-7c4e852f186a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:42.680337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6425f193-213d-4dd9-8865-7c4e852f186a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:42.686746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6425f193-213d-4dd9-8865-7c4e852f186a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:42.687214 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6425f193-213d-4dd9-8865-7c4e852f186a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:42.687986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6425f193-213d-4dd9-8865-7c4e852f186a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:42.688461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6425f193-213d-4dd9-8865-7c4e852f186a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:42.819280 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6425f193-213d-4dd9-8865-7c4e852f186a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:42.821602 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:42.829172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6425f193-213d-4dd9-8865-7c4e852f186a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.153955 Aug 02 21:46:42.829741 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 302/631] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:42 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:43.214178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8946290c-ddbc-4f8c-a405-20005069368b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:43.214798 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8946290c-ddbc-4f8c-a405-20005069368b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:43.221841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8946290c-ddbc-4f8c-a405-20005069368b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:43.222297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8946290c-ddbc-4f8c-a405-20005069368b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:43.223071 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8946290c-ddbc-4f8c-a405-20005069368b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:43.223514 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8946290c-ddbc-4f8c-a405-20005069368b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:43.354650 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8946290c-ddbc-4f8c-a405-20005069368b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:43.362646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8946290c-ddbc-4f8c-a405-20005069368b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.152337 Aug 02 21:46:43.363218 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 330/632] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:43 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:43.850485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bad25317-30ca-47ae-9d96-4dcd5c44217e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:43.851101 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bad25317-30ca-47ae-9d96-4dcd5c44217e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:43.858302 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bad25317-30ca-47ae-9d96-4dcd5c44217e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:43.858750 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bad25317-30ca-47ae-9d96-4dcd5c44217e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:43.859503 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bad25317-30ca-47ae-9d96-4dcd5c44217e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:43.859938 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bad25317-30ca-47ae-9d96-4dcd5c44217e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:44.215428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bad25317-30ca-47ae-9d96-4dcd5c44217e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:44.223229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bad25317-30ca-47ae-9d96-4dcd5c44217e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.376925 Aug 02 21:46:44.223795 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 303/633] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:43 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:44.383782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-123e677a-8c1f-4cac-a50d-b955bac00480 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:44.384428 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-123e677a-8c1f-4cac-a50d-b955bac00480 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:44.390932 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-123e677a-8c1f-4cac-a50d-b955bac00480 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:44.391393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-123e677a-8c1f-4cac-a50d-b955bac00480 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:44.392197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-123e677a-8c1f-4cac-a50d-b955bac00480 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:44.392648 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-123e677a-8c1f-4cac-a50d-b955bac00480 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:44.524971 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-123e677a-8c1f-4cac-a50d-b955bac00480 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:44.536693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-123e677a-8c1f-4cac-a50d-b955bac00480 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1677 microversion: 2.1 time: 0.156723 Aug 02 21:46:44.537269 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 331/634] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:44 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:45.148293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-db7bcf82-0afd-4c7a-b510-485a0f018ec2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:45.150062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-db7bcf82-0afd-4c7a-b510-485a0f018ec2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:45.157764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-db7bcf82-0afd-4c7a-b510-485a0f018ec2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.158212 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-db7bcf82-0afd-4c7a-b510-485a0f018ec2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.158987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-db7bcf82-0afd-4c7a-b510-485a0f018ec2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.159435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-db7bcf82-0afd-4c7a-b510-485a0f018ec2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.190176 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-db7bcf82-0afd-4c7a-b510-485a0f018ec2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments/62bd8bcd-09ae-4d9d-ab56-bc02ba53a8bd" status: 200 len: 194 microversion: 2.20 time: 0.046726 Aug 02 21:46:45.190776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 304/635] 10.222.0.57 () {60 vars in 1454 bytes} [Tue Aug 2 21:46:45 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments/62bd8bcd-09ae-4d9d-ab56-bc02ba53a8bd => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:46:45.244446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4e79f6ed-eb36-4e76-a08d-be6b75f018cb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:45.245785 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4e79f6ed-eb36-4e76-a08d-be6b75f018cb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:45.251669 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e79f6ed-eb36-4e76-a08d-be6b75f018cb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.252252 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e79f6ed-eb36-4e76-a08d-be6b75f018cb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.253038 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e79f6ed-eb36-4e76-a08d-be6b75f018cb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.253611 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4e79f6ed-eb36-4e76-a08d-be6b75f018cb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.264085 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-335b3fa4-77be-49d0-aa14-3e745fcac03a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:45.264614 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-335b3fa4-77be-49d0-aa14-3e745fcac03a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:45.271245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-335b3fa4-77be-49d0-aa14-3e745fcac03a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.271697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-335b3fa4-77be-49d0-aa14-3e745fcac03a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.272493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-335b3fa4-77be-49d0-aa14-3e745fcac03a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.272938 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-335b3fa4-77be-49d0-aa14-3e745fcac03a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.356568 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-335b3fa4-77be-49d0-aa14-3e745fcac03a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lazy-loading 'services' on Instance uuid 581dd5c7-3160-47ed-ac20-6d35cbd6604c {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:46:45.396492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4e79f6ed-eb36-4e76-a08d-be6b75f018cb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:45.405590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4e79f6ed-eb36-4e76-a08d-be6b75f018cb tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.165240 Aug 02 21:46:45.406578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 332/636] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:45 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:45.438868 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-335b3fa4-77be-49d0-aa14-3e745fcac03a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "DELETE /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments/62bd8bcd-09ae-4d9d-ab56-bc02ba53a8bd" status: 202 len: 0 microversion: 2.20 time: 0.179242 Aug 02 21:46:45.439455 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 305/637] 10.222.0.57 () {60 vars in 1457 bytes} [Tue Aug 2 21:46:45 2022] DELETE /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments/62bd8bcd-09ae-4d9d-ab56-bc02ba53a8bd => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 02 21:46:45.448580 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-925623cf-06d5-4a50-9e40-84cda67b32e9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:45.451671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-925623cf-06d5-4a50-9e40-84cda67b32e9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:45.458767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-925623cf-06d5-4a50-9e40-84cda67b32e9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.460084 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-925623cf-06d5-4a50-9e40-84cda67b32e9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.461590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-925623cf-06d5-4a50-9e40-84cda67b32e9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.462037 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-925623cf-06d5-4a50-9e40-84cda67b32e9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.494558 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-925623cf-06d5-4a50-9e40-84cda67b32e9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050066 Aug 02 21:46:45.500835 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 333/638] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 2 21:46:45 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:46:45.563168 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ce91aa65-2105-43d7-95f7-7ecc1205dab6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:45.563892 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ce91aa65-2105-43d7-95f7-7ecc1205dab6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:45.571117 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ce91aa65-2105-43d7-95f7-7ecc1205dab6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.571570 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ce91aa65-2105-43d7-95f7-7ecc1205dab6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.572380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ce91aa65-2105-43d7-95f7-7ecc1205dab6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.572821 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ce91aa65-2105-43d7-95f7-7ecc1205dab6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.705576 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ce91aa65-2105-43d7-95f7-7ecc1205dab6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:45.713191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ce91aa65-2105-43d7-95f7-7ecc1205dab6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1654 microversion: 2.1 time: 0.155890 Aug 02 21:46:45.713766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 306/639] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:45 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:45.734398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b4bd83fb-9872-4d79-9b77-291ac2662305 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:45.742722 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b4bd83fb-9872-4d79-9b77-291ac2662305 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.742722 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b4bd83fb-9872-4d79-9b77-291ac2662305 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.765831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b4bd83fb-9872-4d79-9b77-291ac2662305 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Going to try to start instance {{(pid=124839) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 21:46:45.817578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b4bd83fb-9872-4d79-9b77-291ac2662305 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/action" status: 202 len: 0 microversion: 2.1 time: 0.087745 Aug 02 21:46:45.818268 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 334/640] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:46:45 2022] POST /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:46:45.827063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1d812b5c-e67a-4293-bec1-b474b7e40dd5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:45.827679 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1d812b5c-e67a-4293-bec1-b474b7e40dd5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:45.834138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1d812b5c-e67a-4293-bec1-b474b7e40dd5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.834593 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1d812b5c-e67a-4293-bec1-b474b7e40dd5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.835378 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1d812b5c-e67a-4293-bec1-b474b7e40dd5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:45.835815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1d812b5c-e67a-4293-bec1-b474b7e40dd5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:45.966030 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1d812b5c-e67a-4293-bec1-b474b7e40dd5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:45.973510 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1d812b5c-e67a-4293-bec1-b474b7e40dd5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1663 microversion: 2.1 time: 0.151055 Aug 02 21:46:45.974090 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 307/641] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:45 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:46.430978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b5dad840-ea8f-4dab-aef0-2e6235b2f773 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:46.431685 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b5dad840-ea8f-4dab-aef0-2e6235b2f773 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:46.438484 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b5dad840-ea8f-4dab-aef0-2e6235b2f773 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:46.438927 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b5dad840-ea8f-4dab-aef0-2e6235b2f773 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:46.439705 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b5dad840-ea8f-4dab-aef0-2e6235b2f773 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:46.440162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b5dad840-ea8f-4dab-aef0-2e6235b2f773 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:46.507131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-62fd777e-e793-43b5-9329-2bdaeec084c9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:46.509609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-62fd777e-e793-43b5-9329-2bdaeec084c9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:46.516446 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-62fd777e-e793-43b5-9329-2bdaeec084c9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:46.517053 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-62fd777e-e793-43b5-9329-2bdaeec084c9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:46.518642 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-62fd777e-e793-43b5-9329-2bdaeec084c9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:46.520377 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-62fd777e-e793-43b5-9329-2bdaeec084c9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:46.554644 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-62fd777e-e793-43b5-9329-2bdaeec084c9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051420 Aug 02 21:46:46.555558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 308/642] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 2 21:46:46 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:46.613789 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b5dad840-ea8f-4dab-aef0-2e6235b2f773 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:46.622317 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b5dad840-ea8f-4dab-aef0-2e6235b2f773 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.195773 Aug 02 21:46:46.633654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 335/643] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:46 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:46.633879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c6a92c88-c28b-406d-a55f-3beac8e702cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:46.633879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c6a92c88-c28b-406d-a55f-3beac8e702cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:46.638517 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c6a92c88-c28b-406d-a55f-3beac8e702cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:46.638683 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c6a92c88-c28b-406d-a55f-3beac8e702cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:46.639417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c6a92c88-c28b-406d-a55f-3beac8e702cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:46.639882 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c6a92c88-c28b-406d-a55f-3beac8e702cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:46.665306 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c6a92c88-c28b-406d-a55f-3beac8e702cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:46:46.743107 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c6a92c88-c28b-406d-a55f-3beac8e702cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "DELETE /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 204 len: 0 microversion: 2.20 time: 0.115251 Aug 02 21:46:46.743819 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 309/644] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 2 21:46:46 2022] DELETE /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 21:46:46.752090 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:46.752803 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:46.758767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:46.759219 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:46.759978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:46.760442 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:46.886046 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:46.893981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:46.895746 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:46.896943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6293a6dd-894c-4b73-b661-70f9369bdf7b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.148877 Aug 02 21:46:46.897692 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 336/645] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:46 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:46:46.995099 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-28bed285-b7c3-4edf-bee5-9d7b6adc5b2a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:46.995735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-28bed285-b7c3-4edf-bee5-9d7b6adc5b2a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:47.001950 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-28bed285-b7c3-4edf-bee5-9d7b6adc5b2a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:47.002407 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-28bed285-b7c3-4edf-bee5-9d7b6adc5b2a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:47.003178 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-28bed285-b7c3-4edf-bee5-9d7b6adc5b2a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:47.003621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-28bed285-b7c3-4edf-bee5-9d7b6adc5b2a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:47.129292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-28bed285-b7c3-4edf-bee5-9d7b6adc5b2a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:47.136750 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-28bed285-b7c3-4edf-bee5-9d7b6adc5b2a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1663 microversion: 2.1 time: 0.145971 Aug 02 21:46:47.137821 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 310/646] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:46 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1663 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:47.645908 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9be2aff4-ece0-4bf2-881b-da77230cd4ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:47.646611 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9be2aff4-ece0-4bf2-881b-da77230cd4ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:47.653175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9be2aff4-ece0-4bf2-881b-da77230cd4ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:47.653622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9be2aff4-ece0-4bf2-881b-da77230cd4ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:47.654385 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9be2aff4-ece0-4bf2-881b-da77230cd4ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:47.654818 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9be2aff4-ece0-4bf2-881b-da77230cd4ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:47.792377 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9be2aff4-ece0-4bf2-881b-da77230cd4ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:47.794074 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-9177084f-1c75-4921-be50-a59d5e2294a1 req-0aa9dd71-07f2-4eb2-8263-fadb20a6300c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935f0f24-4d12-498c-bb68-770aa9ee2210", "name": "network-vif-plugged", "status": "completed", "tag": "f59aa865-1125-46ab-a52c-dea7421d5460"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:47.803810 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9be2aff4-ece0-4bf2-881b-da77230cd4ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.161941 Aug 02 21:46:47.804614 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 337/647] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:47 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:47.811664 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-9177084f-1c75-4921-be50-a59d5e2294a1 req-0aa9dd71-07f2-4eb2-8263-fadb20a6300c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:47.811664 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-9177084f-1c75-4921-be50-a59d5e2294a1 req-0aa9dd71-07f2-4eb2-8263-fadb20a6300c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:47.820205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-9177084f-1c75-4921-be50-a59d5e2294a1 req-0aa9dd71-07f2-4eb2-8263-fadb20a6300c service nova] Creating event network-vif-plugged:f59aa865-1125-46ab-a52c-dea7421d5460 for instance 935f0f24-4d12-498c-bb68-770aa9ee2210 on hv-cinder-85144 Aug 02 21:46:47.824974 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-9177084f-1c75-4921-be50-a59d5e2294a1 req-0aa9dd71-07f2-4eb2-8263-fadb20a6300c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101540 Aug 02 21:46:47.825844 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 311/648] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:47.921362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:47.921974 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:47.927935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:47.928416 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:47.929186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:47.929656 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:48.055395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:48.064014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:48.065541 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:48.066709 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a853b102-4abb-4471-9133-157e377f2f52 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.150162 Aug 02 21:46:48.067272 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 338/649] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:47 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:46:48.159255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f61ba16b-cb77-4c07-8718-f123c09c94e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:48.159895 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f61ba16b-cb77-4c07-8718-f123c09c94e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:48.166053 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f61ba16b-cb77-4c07-8718-f123c09c94e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:48.166497 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f61ba16b-cb77-4c07-8718-f123c09c94e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:48.167257 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f61ba16b-cb77-4c07-8718-f123c09c94e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:48.167688 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f61ba16b-cb77-4c07-8718-f123c09c94e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:48.213758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:48.234019 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=10 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:48.307860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f61ba16b-cb77-4c07-8718-f123c09c94e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:48.317147 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f61ba16b-cb77-4c07-8718-f123c09c94e1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1663 microversion: 2.1 time: 0.161879 Aug 02 21:46:48.318046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 312/650] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:48 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:48.825853 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9a31fca4-d030-48a6-9299-005568fb821c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:48.826494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9a31fca4-d030-48a6-9299-005568fb821c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:48.833227 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9a31fca4-d030-48a6-9299-005568fb821c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:48.833673 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9a31fca4-d030-48a6-9299-005568fb821c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:48.834448 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9a31fca4-d030-48a6-9299-005568fb821c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:48.834882 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9a31fca4-d030-48a6-9299-005568fb821c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:48.965356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9a31fca4-d030-48a6-9299-005568fb821c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:48.967640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:48.974569 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9a31fca4-d030-48a6-9299-005568fb821c tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.153212 Aug 02 21:46:48.975134 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 339/651] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:48 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:49.089903 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:49.090461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:49.097060 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:49.097504 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:49.098259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:49.098693 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:49.228774 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:49.237250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:49.238803 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:49.239961 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d24dc845-9e1c-4499-8970-d4ea7ce726fa tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.154291 Aug 02 21:46:49.240686 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 313/652] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:49 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:46:49.346753 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2892fb94-b57c-42b5-9fdf-160efefd1008 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:49.347275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2892fb94-b57c-42b5-9fdf-160efefd1008 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:49.354240 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2892fb94-b57c-42b5-9fdf-160efefd1008 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:49.354689 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2892fb94-b57c-42b5-9fdf-160efefd1008 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:49.355446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2892fb94-b57c-42b5-9fdf-160efefd1008 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:49.355905 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2892fb94-b57c-42b5-9fdf-160efefd1008 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:49.373635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:49.487658 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2892fb94-b57c-42b5-9fdf-160efefd1008 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:49.495104 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2892fb94-b57c-42b5-9fdf-160efefd1008 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1667 microversion: 2.1 time: 0.152587 Aug 02 21:46:49.495669 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 340/653] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:49 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:49.995620 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1a8879c9-27cf-42b0-8f81-146c82c98b47 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:49.996269 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1a8879c9-27cf-42b0-8f81-146c82c98b47 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:50.002201 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1a8879c9-27cf-42b0-8f81-146c82c98b47 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:50.002648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1a8879c9-27cf-42b0-8f81-146c82c98b47 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:50.003400 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1a8879c9-27cf-42b0-8f81-146c82c98b47 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:50.003840 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1a8879c9-27cf-42b0-8f81-146c82c98b47 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:50.130872 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1a8879c9-27cf-42b0-8f81-146c82c98b47 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:50.138206 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1a8879c9-27cf-42b0-8f81-146c82c98b47 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.146450 Aug 02 21:46:50.138771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 314/654] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:49 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:46:50.263728 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:50.264362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:50.271081 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:50.271528 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:50.272315 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:50.272750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:50.520628 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:50.529250 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:50.530787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:50.531958 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a41ead73-5eda-45ff-85ae-de9c51fea0a6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1722 microversion: 2.20 time: 0.272262 Aug 02 21:46:50.532556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 341/655] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:50 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:46:51.160220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-061a0f3d-1a25-4b9c-a741-645ba38ce928 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:51.161075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-061a0f3d-1a25-4b9c-a741-645ba38ce928 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:51.163465 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:51.169564 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-061a0f3d-1a25-4b9c-a741-645ba38ce928 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:51.170025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-061a0f3d-1a25-4b9c-a741-645ba38ce928 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:51.170803 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-061a0f3d-1a25-4b9c-a741-645ba38ce928 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:51.171240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-061a0f3d-1a25-4b9c-a741-645ba38ce928 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:51.320932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-061a0f3d-1a25-4b9c-a741-645ba38ce928 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:51.328597 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-061a0f3d-1a25-4b9c-a741-645ba38ce928 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1365 microversion: 2.1 time: 0.172412 Aug 02 21:46:51.329166 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 315/656] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:51 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:51.551455 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-a087573c-c3ed-4068-966d-6fa0225e2803 req-b7e380f2-34a3-404c-b226-b428437a43b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "581dd5c7-3160-47ed-ac20-6d35cbd6604c", "name": "network-vif-deleted", "tag": "1b078072-8634-47d5-b163-fe8eb6da769b"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:51.556353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:51.557640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:51.562298 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-a087573c-c3ed-4068-966d-6fa0225e2803 req-b7e380f2-34a3-404c-b226-b428437a43b9 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:51.562964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-a087573c-c3ed-4068-966d-6fa0225e2803 req-b7e380f2-34a3-404c-b226-b428437a43b9 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:51.565986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:51.566539 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:51.567621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:51.568325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:51.579711 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-a087573c-c3ed-4068-966d-6fa0225e2803 req-b7e380f2-34a3-404c-b226-b428437a43b9 service nova] Creating event network-vif-deleted:1b078072-8634-47d5-b163-fe8eb6da769b for instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c on hv-cinder-85144 Aug 02 21:46:51.592447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-a087573c-c3ed-4068-966d-6fa0225e2803 req-b7e380f2-34a3-404c-b226-b428437a43b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045533 Aug 02 21:46:51.593920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 342/657] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:51.671977 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:51.683158 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:51.692222 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:51.693909 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-223f6169-59a6-42b1-8c98-65733b816017 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 200 len: 1655 microversion: 2.20 time: 0.142850 Aug 02 21:46:51.695070 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 316/658] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:51 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 1655 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:46:52.350710 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-542fa4e1-0b98-4529-b7f6-0ee5a329c2e4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:52.351702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-542fa4e1-0b98-4529-b7f6-0ee5a329c2e4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:52.358444 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-542fa4e1-0b98-4529-b7f6-0ee5a329c2e4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:52.358893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-542fa4e1-0b98-4529-b7f6-0ee5a329c2e4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:52.359668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-542fa4e1-0b98-4529-b7f6-0ee5a329c2e4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:52.360103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-542fa4e1-0b98-4529-b7f6-0ee5a329c2e4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:52.493359 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-542fa4e1-0b98-4529-b7f6-0ee5a329c2e4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:52.501508 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-542fa4e1-0b98-4529-b7f6-0ee5a329c2e4 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1556 microversion: 2.1 time: 0.154913 Aug 02 21:46:52.502286 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 343/659] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:46:52 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:46:52.522935 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b66e2395-e9a9-4295-98d9-e7aabbb4311d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:52.523439 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b66e2395-e9a9-4295-98d9-e7aabbb4311d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:52.530675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b66e2395-e9a9-4295-98d9-e7aabbb4311d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:52.531136 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b66e2395-e9a9-4295-98d9-e7aabbb4311d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:52.531904 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b66e2395-e9a9-4295-98d9-e7aabbb4311d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:52.532368 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b66e2395-e9a9-4295-98d9-e7aabbb4311d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:52.610244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b66e2395-e9a9-4295-98d9-e7aabbb4311d tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091548 Aug 02 21:46:52.610867 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 317/660] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 2 21:46:52 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:52.724005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:52.724583 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:52.731680 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:52.732158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:52.732940 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:52.733385 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:52.746597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] HTTP exception thrown: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Request method failure captured: Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c HTTP/1.1 Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm8RIm6h-eMB9LyAlRw7kjb73ENP-MbzEO8CdX1-dfobKkZqwlWSJge7anQuePUEgvnuN2FloeteZxhLFJ90xD5LFdwHzRE9ki5-exGFac6qOePHKDVbY4pUh7Vb-gmvFPUsgV9tTJvjFXZ2ZK_Xi0uR1lkl5aWTP_sPyJBZAUNc2I Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:46:52.748318 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_522def96635b48a59492fb7083c3c842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/522def96635b48a59492fb7083c3c842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 57e8eced4d8d49458668a52761e9b8bb Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:46:52.749931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '581dd5c7-3160-47ed-ac20-6d35cbd6604c'} Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:46:52.750887 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:46:52.752370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:46:52.753696 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Returning 404 to user: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:46:52.753696 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-baae2340-e013-44f5-b4ec-5015b597dce2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 404 len: 111 microversion: 2.20 time: 0.029751 Aug 02 21:46:52.753696 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 344/661] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:52 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 21:46:52.759304 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c9dce106-9cee-4187-b905-5537489a54e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '.version_select at 0x7ff55819e310>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:52.779312 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c9dce106-9cee-4187-b905-5537489a54e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-694019276" status: 204 len: 0 microversion: 2.20 time: 0.023822 Aug 02 21:46:52.779941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 318/662] 10.222.0.57 () {60 vars in 1259 bytes} [Tue Aug 2 21:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-694019276 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 21:46:53.409367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-800d458c-e027-43c7-aa31-2e51cb3965a8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'create', calling method: .version_select at 0x7ff552f469d0>, body: {"keypair": {"name": "tempest-keypair-1013692202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLObSMbdMYWnnuhOvNBs8u7D4XX802E1Jo0QwNMmMDf1UktHJV9DRbmo0X/HgcBUHCJ1qN2i0BdAa62KwHe9ErHEhh+FfsbE79MoGakpIc1fydPJQ6trycTvnZX4e63yoA=="}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:53.424666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-800d458c-e027-43c7-aa31-2e51cb3965a8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Getting quotas for project 522def96635b48a59492fb7083c3c842. Resources: {'key_pairs'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:46:53.428894 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-800d458c-e027-43c7-aa31-2e51cb3965a8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Getting quotas for user 57e8eced4d8d49458668a52761e9b8bb and project 522def96635b48a59492fb7083c3c842. Resources: {'key_pairs'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:46:53.444411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:53.452915 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-800d458c-e027-43c7-aa31-2e51cb3965a8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047570 Aug 02 21:46:53.453509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 345/663] 10.222.0.57 () {62 vars in 1200 bytes} [Tue Aug 2 21:46:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 21:46:53.590609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-37df1508-f61a-4c2b-853a-707133b32af3 req-a2be0fa1-4ea1-4488-8325-9a7770213e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935f0f24-4d12-498c-bb68-770aa9ee2210", "tag": "f59aa865-1125-46ab-a52c-dea7421d5460"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:53.601004 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-37df1508-f61a-4c2b-853a-707133b32af3 req-a2be0fa1-4ea1-4488-8325-9a7770213e5d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:53.601808 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-37df1508-f61a-4c2b-853a-707133b32af3 req-a2be0fa1-4ea1-4488-8325-9a7770213e5d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:53.606017 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:53.614332 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-37df1508-f61a-4c2b-853a-707133b32af3 req-a2be0fa1-4ea1-4488-8325-9a7770213e5d service nova] Creating event network-changed:f59aa865-1125-46ab-a52c-dea7421d5460 for instance 935f0f24-4d12-498c-bb68-770aa9ee2210 on hv-cinder-85144 Aug 02 21:46:53.623331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-37df1508-f61a-4c2b-853a-707133b32af3 req-a2be0fa1-4ea1-4488-8325-9a7770213e5d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034861 Aug 02 21:46:53.623331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 319/664] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:46:54.776533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-12904987", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92813ce4-bf95-437e-8aa3-661473d14931"}], "security_groups": [{"name": "tempest-securitygroup--1646720222"}], "key_name": "tempest-keypair-1013692202", "user_data": "}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:54.884453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] validate_networks() for [('92813ce4-bf95-437e-8aa3-661473d14931', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:46:55.287987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:46:55.288452 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:46:55.288963 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:46:55.289381 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:46:55.289801 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:46:55.298543 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:55.298996 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:55.299807 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:55.300290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:55.316594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Getting quotas for project 522def96635b48a59492fb7083c3c842. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:46:55.320560 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Getting quotas for user 57e8eced4d8d49458668a52761e9b8bb and project 522def96635b48a59492fb7083c3c842. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:46:55.331918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:46:55.334170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:46:55.382030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-83f99710-8a5e-4947-9eb3-3fc160f1e5dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.611487 Aug 02 21:46:55.382845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 346/665] 10.222.0.57 () {62 vars in 1188 bytes} [Tue Aug 2 21:46:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 21:46:55.395852 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9dad7f85-6eaf-4c3d-9dc2-bd4cff4dc269 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:55.396585 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9dad7f85-6eaf-4c3d-9dc2-bd4cff4dc269 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:55.453755 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9dad7f85-6eaf-4c3d-9dc2-bd4cff4dc269 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:55.462765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9dad7f85-6eaf-4c3d-9dc2-bd4cff4dc269 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:55.464351 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9dad7f85-6eaf-4c3d-9dc2-bd4cff4dc269 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:55.466145 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9dad7f85-6eaf-4c3d-9dc2-bd4cff4dc269 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1280 microversion: 2.20 time: 0.075335 Aug 02 21:46:55.466686 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 320/666] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:55 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 21:46:56.489902 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:56.490522 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:56.497335 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:56.497793 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:56.498571 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:56.499015 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:56.576409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:56.584881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:56.586387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:56.587524 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9bf102a6-2a90-49d7-97a9-76c84387c395 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1338 microversion: 2.20 time: 0.102196 Aug 02 21:46:56.588082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 347/667] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:56 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:46:57.609929 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:57.610470 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:57.618135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:57.618802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:57.619562 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:57.620095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:57.678199 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-f0f5fda4-48de-4f55-b57d-c153f7f21b16 req-fbda87a7-a6b0-49e8-abc3-dbb6469bd5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f0e81e-d7e8-45f4-96c5-08aedf7cc9da", "tag": "fe08db00-0856-4a99-90d2-bcbf21c1a129"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:46:57.693434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-f0f5fda4-48de-4f55-b57d-c153f7f21b16 req-fbda87a7-a6b0-49e8-abc3-dbb6469bd5c5 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:57.693988 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-f0f5fda4-48de-4f55-b57d-c153f7f21b16 req-fbda87a7-a6b0-49e8-abc3-dbb6469bd5c5 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:57.721477 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-f0f5fda4-48de-4f55-b57d-c153f7f21b16 req-fbda87a7-a6b0-49e8-abc3-dbb6469bd5c5 service nova] Creating event network-changed:fe08db00-0856-4a99-90d2-bcbf21c1a129 for instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da on hv-cinder-85144 Aug 02 21:46:57.733868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-f0f5fda4-48de-4f55-b57d-c153f7f21b16 req-fbda87a7-a6b0-49e8-abc3-dbb6469bd5c5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060411 Aug 02 21:46:57.734993 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 348/668] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:46:57.775255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:57.783900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:57.785498 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:57.786739 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-36327ec7-fa1a-4a4f-8421-1da87cebe327 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1406 microversion: 2.20 time: 0.180977 Aug 02 21:46:57.787303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 321/669] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:57 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:46:58.810355 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:58.811058 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:58.817474 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:58.817929 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:58.818739 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:58.819184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:58.948532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:58.956592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:58.958098 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:46:58.959240 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2b80e604-da06-4a63-8071-99dfd540713b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1406 microversion: 2.20 time: 0.153678 Aug 02 21:46:58.959799 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 349/670] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:58 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:46:59.981897 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:46:59.982546 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:46:59.989303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:59.989801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:46:59.991142 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:46:59.991593 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:00.118480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:00.127078 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:00.128651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:00.129754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9dddb4dc-2a8a-48dd-b918-6a7944070da0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1406 microversion: 2.20 time: 0.151819 Aug 02 21:47:00.130311 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 322/671] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:46:59 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:47:01.153017 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:01.153628 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:01.160030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:01.160526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:01.161292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:01.161758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:01.380043 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:01.390786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:01.392348 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:01.393453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-81063f26-aefb-467b-a708-25a624a8a810 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1406 microversion: 2.20 time: 0.244478 Aug 02 21:47:01.394292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 350/672] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:47:01 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:47:02.416561 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:02.417178 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:02.424242 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:02.424702 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:02.425476 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:02.425918 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:02.552539 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:02.560588 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:02.562053 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:02.563175 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a4a85e11-7a28-4026-ae38-ce2fd157bd08 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1406 microversion: 2.20 time: 0.150652 Aug 02 21:47:02.563817 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 323/673] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:47:02 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:47:03.586124 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:03.586735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:03.592949 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:03.593402 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:03.594175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:03.594609 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:03.724270 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:03.733052 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:03.734549 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:03.735666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-02f38bff-5358-462a-8ed6-1344e8bff142 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1406 microversion: 2.20 time: 0.153449 Aug 02 21:47:03.744303 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 351/674] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:47:03 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:47:03.804996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-85fd1e5b-e896-4a74-a1a3-7e3891392e13 req-e4b0dc74-d169-43b9-aecc-57931c36f7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f0e81e-d7e8-45f4-96c5-08aedf7cc9da", "name": "network-vif-plugged", "status": "completed", "tag": "fe08db00-0856-4a99-90d2-bcbf21c1a129"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:03.817846 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-85fd1e5b-e896-4a74-a1a3-7e3891392e13 req-e4b0dc74-d169-43b9-aecc-57931c36f7cd service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:03.818384 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-85fd1e5b-e896-4a74-a1a3-7e3891392e13 req-e4b0dc74-d169-43b9-aecc-57931c36f7cd service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:03.830778 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-85fd1e5b-e896-4a74-a1a3-7e3891392e13 req-e4b0dc74-d169-43b9-aecc-57931c36f7cd service nova] Creating event network-vif-plugged:fe08db00-0856-4a99-90d2-bcbf21c1a129 for instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da on hv-cinder-85144 Aug 02 21:47:03.835991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-85fd1e5b-e896-4a74-a1a3-7e3891392e13 req-e4b0dc74-d169-43b9-aecc-57931c36f7cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040570 Aug 02 21:47:03.836749 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 324/675] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:04.758582 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:04.759201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:04.766304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:04.766787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:04.767560 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:04.768004 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:04.900041 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:04.908505 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:04.910011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:04.911101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-32fbc762-7cbe-4c2b-89f9-994ba24ba6c2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1406 microversion: 2.20 time: 0.156412 Aug 02 21:47:04.911649 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 352/676] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:47:04 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:47:05.929915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:05.934268 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:05.934963 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:05.941362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:05.941812 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:05.942572 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:05.943007 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:06.074685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:06.082547 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:06.084085 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:06.085258 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-98ea8d5f-bb55-40b8-94f6-42d61b1f682b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1598 microversion: 2.20 time: 0.156790 Aug 02 21:47:06.085816 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 325/677] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:47:05 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:47:06.107492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-739be656-c250-4aff-8c88-d4d4b7b90946 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:06.108010 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-739be656-c250-4aff-8c88-d4d4b7b90946 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:06.110060 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:06.110702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=10 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:06.117421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-739be656-c250-4aff-8c88-d4d4b7b90946 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:06.117869 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-739be656-c250-4aff-8c88-d4d4b7b90946 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:06.118663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-739be656-c250-4aff-8c88-d4d4b7b90946 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:06.119105 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-739be656-c250-4aff-8c88-d4d4b7b90946 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:06.199715 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-739be656-c250-4aff-8c88-d4d4b7b90946 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096034 Aug 02 21:47:06.200399 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 353/678] 10.222.0.57 () {60 vars in 1316 bytes} [Tue Aug 2 21:47:06 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:47:07.125033 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-ddf54f48-7f3c-4368-b196-b998338d08e6 req-93538413-cd9f-4dad-95be-7d38cb437ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f0e81e-d7e8-45f4-96c5-08aedf7cc9da", "tag": "fe08db00-0856-4a99-90d2-bcbf21c1a129"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:07.134627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-ddf54f48-7f3c-4368-b196-b998338d08e6 req-93538413-cd9f-4dad-95be-7d38cb437ba0 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:07.135069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-ddf54f48-7f3c-4368-b196-b998338d08e6 req-93538413-cd9f-4dad-95be-7d38cb437ba0 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:07.146558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-ddf54f48-7f3c-4368-b196-b998338d08e6 req-93538413-cd9f-4dad-95be-7d38cb437ba0 service nova] Creating event network-changed:fe08db00-0856-4a99-90d2-bcbf21c1a129 for instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da on hv-cinder-85144 Aug 02 21:47:07.151535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-ddf54f48-7f3c-4368-b196-b998338d08e6 req-93538413-cd9f-4dad-95be-7d38cb437ba0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030131 Aug 02 21:47:07.152469 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 326/679] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:12.624647 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fdbbd5bd-cc25-43cc-9c28-91cf70af5304 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:12.625159 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-fdbbd5bd-cc25-43cc-9c28-91cf70af5304 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:12.631808 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fdbbd5bd-cc25-43cc-9c28-91cf70af5304 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:12.632304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fdbbd5bd-cc25-43cc-9c28-91cf70af5304 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:12.633073 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fdbbd5bd-cc25-43cc-9c28-91cf70af5304 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:12.633510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fdbbd5bd-cc25-43cc-9c28-91cf70af5304 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:12.713013 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-fdbbd5bd-cc25-43cc-9c28-91cf70af5304 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lazy-loading 'services' on Instance uuid 3a9e4798-b622-408c-badf-10489a6cc310 {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:47:12.783395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-fdbbd5bd-cc25-43cc-9c28-91cf70af5304 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments/a4ed1db7-6ecb-4fc5-83e4-29e8e554891e" status: 202 len: 0 microversion: 2.1 time: 0.163309 Aug 02 21:47:12.784255 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 354/680] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:47:12 2022] DELETE /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments/a4ed1db7-6ecb-4fc5-83e4-29e8e554891e => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:47:12.793969 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-49f61636-613c-4da7-963f-d6b529f3d3d4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:12.797002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-49f61636-613c-4da7-963f-d6b529f3d3d4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:12.804923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-49f61636-613c-4da7-963f-d6b529f3d3d4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:12.805808 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-49f61636-613c-4da7-963f-d6b529f3d3d4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:12.807066 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-49f61636-613c-4da7-963f-d6b529f3d3d4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:12.808229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-49f61636-613c-4da7-963f-d6b529f3d3d4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:12.840838 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-49f61636-613c-4da7-963f-d6b529f3d3d4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051293 Aug 02 21:47:12.841393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 327/681] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:47:12 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:13.853976 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f7322ca0-0406-48b7-953e-84dd636c3f1e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:13.857020 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f7322ca0-0406-48b7-953e-84dd636c3f1e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:13.863825 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7322ca0-0406-48b7-953e-84dd636c3f1e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:13.864256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7322ca0-0406-48b7-953e-84dd636c3f1e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:13.865047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7322ca0-0406-48b7-953e-84dd636c3f1e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:13.865491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f7322ca0-0406-48b7-953e-84dd636c3f1e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:13.895395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f7322ca0-0406-48b7-953e-84dd636c3f1e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 02 21:47:13.896005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 355/682] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:47:13 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:14.907553 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-aa11b781-36a5-45b0-a98a-6ad1b64dca5c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:14.909972 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-aa11b781-36a5-45b0-a98a-6ad1b64dca5c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:14.916402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa11b781-36a5-45b0-a98a-6ad1b64dca5c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:14.917342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa11b781-36a5-45b0-a98a-6ad1b64dca5c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:14.918117 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa11b781-36a5-45b0-a98a-6ad1b64dca5c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:14.918550 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa11b781-36a5-45b0-a98a-6ad1b64dca5c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:14.946942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-aa11b781-36a5-45b0-a98a-6ad1b64dca5c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043364 Aug 02 21:47:14.947489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 328/683] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:47:14 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:47:15.031034 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-db4155bc-a86c-4254-b577-a3fa6df17750 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:15.031577 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-db4155bc-a86c-4254-b577-a3fa6df17750 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:15.038017 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-db4155bc-a86c-4254-b577-a3fa6df17750 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:15.038469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-db4155bc-a86c-4254-b577-a3fa6df17750 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:15.039240 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-db4155bc-a86c-4254-b577-a3fa6df17750 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:15.039690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-db4155bc-a86c-4254-b577-a3fa6df17750 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:15.065508 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-db4155bc-a86c-4254-b577-a3fa6df17750 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:47:15.138591 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-db4155bc-a86c-4254-b577-a3fa6df17750 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 204 len: 0 microversion: 2.1 time: 0.111045 Aug 02 21:47:15.139153 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 356/684] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:47:15 2022] DELETE /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:47:15.147438 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ab795403-601e-4a40-a05a-2cf2157ff074 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:15.148276 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ab795403-601e-4a40-a05a-2cf2157ff074 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:15.155062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab795403-601e-4a40-a05a-2cf2157ff074 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:15.155571 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab795403-601e-4a40-a05a-2cf2157ff074 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:15.156398 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab795403-601e-4a40-a05a-2cf2157ff074 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:15.156841 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ab795403-601e-4a40-a05a-2cf2157ff074 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:15.289207 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ab795403-601e-4a40-a05a-2cf2157ff074 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:15.297272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ab795403-601e-4a40-a05a-2cf2157ff074 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1688 microversion: 2.1 time: 0.153992 Aug 02 21:47:15.297837 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 329/685] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:15 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:16.319275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b3167c9c-734c-44ad-bb67-ab1d29cb199b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:16.319985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b3167c9c-734c-44ad-bb67-ab1d29cb199b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:16.326620 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3167c9c-734c-44ad-bb67-ab1d29cb199b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:16.327066 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3167c9c-734c-44ad-bb67-ab1d29cb199b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:16.327838 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3167c9c-734c-44ad-bb67-ab1d29cb199b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:16.328312 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b3167c9c-734c-44ad-bb67-ab1d29cb199b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:16.460470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b3167c9c-734c-44ad-bb67-ab1d29cb199b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:16.468543 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b3167c9c-734c-44ad-bb67-ab1d29cb199b tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1688 microversion: 2.1 time: 0.153423 Aug 02 21:47:16.469110 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 357/686] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:16 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:17.489809 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c84574bd-7a4e-4976-9054-eb41e3746bf4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:17.490340 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c84574bd-7a4e-4976-9054-eb41e3746bf4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:17.497445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c84574bd-7a4e-4976-9054-eb41e3746bf4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:17.497873 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c84574bd-7a4e-4976-9054-eb41e3746bf4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:17.498639 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c84574bd-7a4e-4976-9054-eb41e3746bf4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:17.499082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c84574bd-7a4e-4976-9054-eb41e3746bf4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:17.628401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c84574bd-7a4e-4976-9054-eb41e3746bf4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:17.636557 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c84574bd-7a4e-4976-9054-eb41e3746bf4 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1688 microversion: 2.1 time: 0.150201 Aug 02 21:47:17.637128 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 330/687] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:17 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:18.658410 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-110c276c-bd44-49df-8c4e-3d5bd6b6b432 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:18.659050 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-110c276c-bd44-49df-8c4e-3d5bd6b6b432 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:18.665497 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-110c276c-bd44-49df-8c4e-3d5bd6b6b432 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:18.665953 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-110c276c-bd44-49df-8c4e-3d5bd6b6b432 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:18.666723 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-110c276c-bd44-49df-8c4e-3d5bd6b6b432 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:18.667162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-110c276c-bd44-49df-8c4e-3d5bd6b6b432 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:18.671136 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:18.795696 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-110c276c-bd44-49df-8c4e-3d5bd6b6b432 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:18.803434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-110c276c-bd44-49df-8c4e-3d5bd6b6b432 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1688 microversion: 2.1 time: 0.148870 Aug 02 21:47:18.804011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 358/688] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:18 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:19.825133 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-289ddeb9-91ac-4a70-9133-a361831db300 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:19.825751 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-289ddeb9-91ac-4a70-9133-a361831db300 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:19.833845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-289ddeb9-91ac-4a70-9133-a361831db300 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:19.834820 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-289ddeb9-91ac-4a70-9133-a361831db300 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:19.835925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-289ddeb9-91ac-4a70-9133-a361831db300 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:19.836398 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-289ddeb9-91ac-4a70-9133-a361831db300 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:19.900893 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-289ddeb9-91ac-4a70-9133-a361831db300 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:19.909382 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-289ddeb9-91ac-4a70-9133-a361831db300 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1623 microversion: 2.1 time: 0.088425 Aug 02 21:47:19.909967 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 331/689] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:19 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1623 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:20.427498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-2199bc31-2a5d-4d4d-ba24-b7f2ed68212a req-ee8281f8-b11d-482c-95b6-bee7cd6e3c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a9e4798-b622-408c-badf-10489a6cc310", "name": "network-vif-deleted", "tag": "a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:20.438895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-2199bc31-2a5d-4d4d-ba24-b7f2ed68212a req-ee8281f8-b11d-482c-95b6-bee7cd6e3c87 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:20.439339 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-2199bc31-2a5d-4d4d-ba24-b7f2ed68212a req-ee8281f8-b11d-482c-95b6-bee7cd6e3c87 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:20.452042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-2199bc31-2a5d-4d4d-ba24-b7f2ed68212a req-ee8281f8-b11d-482c-95b6-bee7cd6e3c87 service nova] Creating event network-vif-deleted:a4e68af3-b227-4c3c-bf4a-f13b8f63ae6f for instance 3a9e4798-b622-408c-badf-10489a6cc310 on hv-cinder-85144 Aug 02 21:47:20.458387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-2199bc31-2a5d-4d4d-ba24-b7f2ed68212a req-ee8281f8-b11d-482c-95b6-bee7cd6e3c87 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034312 Aug 02 21:47:20.459737 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 359/690] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:20.931010 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:20.931697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:20.939091 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:20.939799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:20.940830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:20.941272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:20.974878 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:20.975331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:20.975787 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lazy-loading 'fault' on Instance uuid 3a9e4798-b622-408c-badf-10489a6cc310 {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:47:21.018468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:21.027872 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-aa29b52c-3d1d-452f-bca0-a6cd544bd0cb tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 200 len: 1336 microversion: 2.1 time: 0.100802 Aug 02 21:47:21.028821 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 332/691] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:20 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:22.050997 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:22.051747 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 3a9e4798-b622-408c-badf-10489a6cc310] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:22.058400 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:22.058851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:22.059638 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:22.060096 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:22.073490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] HTTP exception thrown: Instance 3a9e4798-b622-408c-badf-10489a6cc310 could not be found. Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Request method failure captured: Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 HTTP/1.1 Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZojLJbT9egEuZ8DBMGJ-XCKy-RVgSsX5Owqz-9MyiQob2d6kzqcQN2c30OKBc5PmkGknR8KsxNmw1Pz3neJWOfjR480RI1jW--uB9XwgzYzFYNwgbENme-j3Uzt7HcmMxD3f42lQJJ3XL9SA9jWOgU-EDdAyh64H0xzo83X2oh-3GA Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:47:22.075062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ad2873976b194c2daf265f84f5e60519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: c9f838395a2247e49e0acacd0fdadb2b Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 3a9e4798-b622-408c-badf-10489a6cc310 could not be found. Aug 02 21:47:22.076893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '3a9e4798-b622-408c-badf-10489a6cc310'} Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a9e4798-b622-408c-badf-10489a6cc310 could not be found. Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:47:22.077775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a9e4798-b622-408c-badf-10489a6cc310 could not be found. Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a9e4798-b622-408c-badf-10489a6cc310 could not be found. Aug 02 21:47:22.079201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:22.080775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Returning 404 to user: Instance 3a9e4798-b622-408c-badf-10489a6cc310 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:47:22.080775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d81894d0-cb91-4ba9-9a92-81f1b66abe7e tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310" status: 404 len: 111 microversion: 2.1 time: 0.030106 Aug 02 21:47:22.080775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 360/692] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:22 2022] GET /compute/v2.1/servers/3a9e4798-b622-408c-badf-10489a6cc310 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:47:22.085249 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-deefe942-401e-4ed3-893d-dd71fe1d3591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '.version_select at 0x7ff552e4faf0>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:22.092072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:22.105372 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-deefe942-401e-4ed3-893d-dd71fe1d3591 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098487414" status: 202 len: 0 microversion: 2.1 time: 0.023947 Aug 02 21:47:22.105935 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 333/693] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 2 21:47:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098487414 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:47:24.944348 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0f3ec13c-6b64-4183-b7c9-81463e659ad9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:24.944846 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0f3ec13c-6b64-4183-b7c9-81463e659ad9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:24.947266 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:24.953139 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f3ec13c-6b64-4183-b7c9-81463e659ad9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:24.953590 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f3ec13c-6b64-4183-b7c9-81463e659ad9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:24.954352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f3ec13c-6b64-4183-b7c9-81463e659ad9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:24.954786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f3ec13c-6b64-4183-b7c9-81463e659ad9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:24.980874 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0f3ec13c-6b64-4183-b7c9-81463e659ad9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:47:25.054421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0f3ec13c-6b64-4183-b7c9-81463e659ad9 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 204 len: 0 microversion: 2.1 time: 0.113453 Aug 02 21:47:25.055114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 361/694] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:47:24 2022] DELETE /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:47:25.064684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-93b85200-b991-4159-95ce-9fe013e19967 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:25.065303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-93b85200-b991-4159-95ce-9fe013e19967 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:25.071896 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-93b85200-b991-4159-95ce-9fe013e19967 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:25.072392 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-93b85200-b991-4159-95ce-9fe013e19967 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:25.073761 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-93b85200-b991-4159-95ce-9fe013e19967 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:25.074208 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-93b85200-b991-4159-95ce-9fe013e19967 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:25.205445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-93b85200-b991-4159-95ce-9fe013e19967 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:25.212967 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-93b85200-b991-4159-95ce-9fe013e19967 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1507 microversion: 2.1 time: 0.153004 Aug 02 21:47:25.213525 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 334/695] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:25 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:26.235099 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b1aa623c-269d-4d53-b025-c3f10446f06c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:26.235711 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b1aa623c-269d-4d53-b025-c3f10446f06c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:26.242194 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b1aa623c-269d-4d53-b025-c3f10446f06c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:26.242642 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b1aa623c-269d-4d53-b025-c3f10446f06c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:26.243401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b1aa623c-269d-4d53-b025-c3f10446f06c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:26.243834 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b1aa623c-269d-4d53-b025-c3f10446f06c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:26.373932 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b1aa623c-269d-4d53-b025-c3f10446f06c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:26.381282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b1aa623c-269d-4d53-b025-c3f10446f06c tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1507 microversion: 2.1 time: 0.150521 Aug 02 21:47:26.381842 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 362/696] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:26 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:27.402559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fde8a332-d2c3-4385-9e2d-869e3516c08a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:27.403184 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fde8a332-d2c3-4385-9e2d-869e3516c08a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:27.409714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fde8a332-d2c3-4385-9e2d-869e3516c08a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:27.410173 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fde8a332-d2c3-4385-9e2d-869e3516c08a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:27.410947 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fde8a332-d2c3-4385-9e2d-869e3516c08a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:27.411388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fde8a332-d2c3-4385-9e2d-869e3516c08a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:27.415325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=74 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:27.543866 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fde8a332-d2c3-4385-9e2d-869e3516c08a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:27.551729 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fde8a332-d2c3-4385-9e2d-869e3516c08a tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 200 len: 1507 microversion: 2.1 time: 0.153084 Aug 02 21:47:27.552319 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 335/697] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:27 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:27.954716 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-be86f1ed-2ec6-4e7c-b519-ff2898cb952f req-e8f228d4-6d6c-4b37-9823-56cfe35827e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7dc5f2b-749d-4f59-8fae-f0ed0aad7517", "name": "network-vif-deleted", "tag": "3e9eac3d-e456-4a44-ad24-2248cf4e97b1"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:27.966512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-be86f1ed-2ec6-4e7c-b519-ff2898cb952f req-e8f228d4-6d6c-4b37-9823-56cfe35827e9 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:27.966964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-be86f1ed-2ec6-4e7c-b519-ff2898cb952f req-e8f228d4-6d6c-4b37-9823-56cfe35827e9 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:27.979699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-be86f1ed-2ec6-4e7c-b519-ff2898cb952f req-e8f228d4-6d6c-4b37-9823-56cfe35827e9 service nova] Creating event network-vif-deleted:3e9eac3d-e456-4a44-ad24-2248cf4e97b1 for instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 on hv-cinder-85144 Aug 02 21:47:27.985715 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-be86f1ed-2ec6-4e7c-b519-ff2898cb952f req-e8f228d4-6d6c-4b37-9823-56cfe35827e9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035720 Aug 02 21:47:27.986447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 363/698] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:28.574814 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:28.575532 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: c7dc5f2b-749d-4f59-8fae-f0ed0aad7517] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:28.582838 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:28.583362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:28.584154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:28.584601 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:28.598762 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] HTTP exception thrown: Instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 could not be found. Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Request method failure captured: Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 HTTP/1.1 Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6ZojLJbT9egEuZ8DBMGJ-XCKy-RVgSsX5Owqz-9MyiQob2d6kzqcQN2c30OKBc5PmkGknR8KsxNmw1Pz3neJWOfjR480RI1jW--uB9XwgzYzFYNwgbENme-j3Uzt7HcmMxD3f42lQJJ3XL9SA9jWOgU-EDdAyh64H0xzo83X2oh-3GA Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:47:28.600541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ad2873976b194c2daf265f84f5e60519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: c9f838395a2247e49e0acacd0fdadb2b Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 could not be found. Aug 02 21:47:28.602154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'c7dc5f2b-749d-4f59-8fae-f0ed0aad7517'} Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 could not be found. Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:47:28.603435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 could not be found. Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 could not be found. Aug 02 21:47:28.605197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:28.606627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Returning 404 to user: Instance c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:47:28.606627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a45bbf50-0033-4a08-913e-6fc0b24eaf80 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517" status: 404 len: 111 microversion: 2.1 time: 0.031938 Aug 02 21:47:28.606627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 336/699] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:28 2022] GET /compute/v2.1/servers/c7dc5f2b-749d-4f59-8fae-f0ed0aad7517 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 21:47:28.611573 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b50cc4aa-6f27-4387-8fc2-487bad495244 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:28.612189 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b50cc4aa-6f27-4387-8fc2-487bad495244 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:28.618621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b50cc4aa-6f27-4387-8fc2-487bad495244 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:28.619759 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b50cc4aa-6f27-4387-8fc2-487bad495244 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:28.620580 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b50cc4aa-6f27-4387-8fc2-487bad495244 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:28.621210 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b50cc4aa-6f27-4387-8fc2-487bad495244 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:28.648671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b50cc4aa-6f27-4387-8fc2-487bad495244 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:47:28.721097 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b50cc4aa-6f27-4387-8fc2-487bad495244 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 204 len: 0 microversion: 2.1 time: 0.113546 Aug 02 21:47:28.721912 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 364/700] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:47:28 2022] DELETE /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:47:28.730931 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-19bfe557-9556-432c-875a-319da7dace74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:28.731577 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-19bfe557-9556-432c-875a-319da7dace74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:28.737843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19bfe557-9556-432c-875a-319da7dace74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:28.738253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19bfe557-9556-432c-875a-319da7dace74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:28.739001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19bfe557-9556-432c-875a-319da7dace74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:28.739442 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-19bfe557-9556-432c-875a-319da7dace74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:29.100345 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-19bfe557-9556-432c-875a-319da7dace74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:29.107797 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-19bfe557-9556-432c-875a-319da7dace74 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.381914 Aug 02 21:47:29.108391 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 337/701] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:28 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:30.129572 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-351d0bcb-5cd2-4899-b7ef-642b46abbbc0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:30.130342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-351d0bcb-5cd2-4899-b7ef-642b46abbbc0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:30.136965 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-351d0bcb-5cd2-4899-b7ef-642b46abbbc0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:30.137418 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-351d0bcb-5cd2-4899-b7ef-642b46abbbc0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:30.138191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-351d0bcb-5cd2-4899-b7ef-642b46abbbc0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:30.138633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-351d0bcb-5cd2-4899-b7ef-642b46abbbc0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:30.285617 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-351d0bcb-5cd2-4899-b7ef-642b46abbbc0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:30.293529 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-351d0bcb-5cd2-4899-b7ef-642b46abbbc0 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.168256 Aug 02 21:47:30.294093 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 365/702] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:30 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:31.314598 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c7893fae-a59c-41f8-839a-a4dc81526556 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:31.315253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c7893fae-a59c-41f8-839a-a4dc81526556 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:31.321878 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c7893fae-a59c-41f8-839a-a4dc81526556 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:31.322337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c7893fae-a59c-41f8-839a-a4dc81526556 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:31.323111 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c7893fae-a59c-41f8-839a-a4dc81526556 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:31.323555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c7893fae-a59c-41f8-839a-a4dc81526556 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:31.453029 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c7893fae-a59c-41f8-839a-a4dc81526556 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:31.460494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c7893fae-a59c-41f8-839a-a4dc81526556 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1520 microversion: 2.1 time: 0.149701 Aug 02 21:47:31.461006 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 338/703] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:31 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:32.407678 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-3cd06dfc-34cd-4921-b666-9006724d6edc req-bf20fc5b-b939-477c-8ffc-bbd18a8dc017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5254075d-3708-4f10-a1cd-2a6dff86e864", "name": "network-vif-deleted", "tag": "7b39e35a-5648-4684-ad8d-9d240cb19dee"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:32.415882 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f02f9212-55f6-40d8-92c8-12c75c37a4e3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:32.418329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-3cd06dfc-34cd-4921-b666-9006724d6edc req-bf20fc5b-b939-477c-8ffc-bbd18a8dc017 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:32.418780 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-3cd06dfc-34cd-4921-b666-9006724d6edc req-bf20fc5b-b939-477c-8ffc-bbd18a8dc017 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:32.423588 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f02f9212-55f6-40d8-92c8-12c75c37a4e3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:32.430687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-3cd06dfc-34cd-4921-b666-9006724d6edc req-bf20fc5b-b939-477c-8ffc-bbd18a8dc017 service nova] Creating event network-vif-deleted:7b39e35a-5648-4684-ad8d-9d240cb19dee for instance 5254075d-3708-4f10-a1cd-2a6dff86e864 on hv-cinder-85144 Aug 02 21:47:32.432164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f02f9212-55f6-40d8-92c8-12c75c37a4e3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:32.432623 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f02f9212-55f6-40d8-92c8-12c75c37a4e3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:32.435630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f02f9212-55f6-40d8-92c8-12c75c37a4e3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:32.436059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f02f9212-55f6-40d8-92c8-12c75c37a4e3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:32.436233 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-3cd06dfc-34cd-4921-b666-9006724d6edc req-bf20fc5b-b939-477c-8ffc-bbd18a8dc017 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Aug 02 21:47:32.436787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 366/704] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:32.465629 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f02f9212-55f6-40d8-92c8-12c75c37a4e3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:47:32.486009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-170783ab-d7be-401f-83ec-7c449918ac56 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:32.486723 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-170783ab-d7be-401f-83ec-7c449918ac56 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:32.495243 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-170783ab-d7be-401f-83ec-7c449918ac56 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:32.495994 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-170783ab-d7be-401f-83ec-7c449918ac56 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:32.496837 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-170783ab-d7be-401f-83ec-7c449918ac56 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:32.497275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-170783ab-d7be-401f-83ec-7c449918ac56 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:32.553845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f02f9212-55f6-40d8-92c8-12c75c37a4e3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 204 len: 0 microversion: 2.1 time: 0.143531 Aug 02 21:47:32.554682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 339/705] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:47:32 2022] DELETE /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:47:32.563770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4f1f8167-1a23-4195-b438-577de00ee11c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:32.564555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4f1f8167-1a23-4195-b438-577de00ee11c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:32.569291 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-170783ab-d7be-401f-83ec-7c449918ac56 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:32.574001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f1f8167-1a23-4195-b438-577de00ee11c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:32.574480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f1f8167-1a23-4195-b438-577de00ee11c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:32.575315 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f1f8167-1a23-4195-b438-577de00ee11c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:32.575752 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f1f8167-1a23-4195-b438-577de00ee11c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:32.578760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-170783ab-d7be-401f-83ec-7c449918ac56 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1306 microversion: 2.1 time: 0.100741 Aug 02 21:47:32.579986 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 367/706] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:32 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:32.720864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4f1f8167-1a23-4195-b438-577de00ee11c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:32.728848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4f1f8167-1a23-4195-b438-577de00ee11c tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1577 microversion: 2.1 time: 0.168732 Aug 02 21:47:32.729436 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 340/707] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:32 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:33.600683 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:33.601293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:33.607431 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:33.608001 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:33.608791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:33.609227 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:33.639566 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:33.640011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:33.640484 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lazy-loading 'fault' on Instance uuid 5254075d-3708-4f10-a1cd-2a6dff86e864 {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:47:33.680042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f838395a2247e49e0acacd0fdadb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2873976b194c2daf265f84f5e60519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:33.687341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-826bfa05-d22f-491d-b270-9b9e71ba05a7 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 200 len: 1311 microversion: 2.1 time: 0.090544 Aug 02 21:47:33.687893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 368/708] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:33 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:33.750064 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0cf961af-238e-4c7b-a90f-7f20e746eaa6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:33.750744 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0cf961af-238e-4c7b-a90f-7f20e746eaa6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:33.756952 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0cf961af-238e-4c7b-a90f-7f20e746eaa6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:33.757406 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0cf961af-238e-4c7b-a90f-7f20e746eaa6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:33.758179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0cf961af-238e-4c7b-a90f-7f20e746eaa6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:33.758619 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0cf961af-238e-4c7b-a90f-7f20e746eaa6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:33.889463 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0cf961af-238e-4c7b-a90f-7f20e746eaa6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:33.897135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0cf961af-238e-4c7b-a90f-7f20e746eaa6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1577 microversion: 2.1 time: 0.151014 Aug 02 21:47:33.897706 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 341/709] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:33 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:34.709020 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:34.709637 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] [instance: 5254075d-3708-4f10-a1cd-2a6dff86e864] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:34.716656 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:34.717109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:34.717916 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:34.718355 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:34.732625 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] HTTP exception thrown: Instance 5254075d-3708-4f10-a1cd-2a6dff86e864 could not be found. Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Request method failure captured: Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 HTTP/1.1 Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZojLJbT9egEuZ8DBMGJ-XCKy-RVgSsX5Owqz-9MyiQob2d6kzqcQN2c30OKBc5PmkGknR8KsxNmw1Pz3neJWOfjR480RI1jW--uB9XwgzYzFYNwgbENme-j3Uzt7HcmMxD3f42lQJJ3XL9SA9jWOgU-EDdAyh64H0xzo83X2oh-3GA Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:47:34.734278 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ad2873976b194c2daf265f84f5e60519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ad2873976b194c2daf265f84f5e60519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: ad2873976b194c2daf265f84f5e60519 Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1203280962 Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: c9f838395a2247e49e0acacd0fdadb2b Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1203280962-project Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 5254075d-3708-4f10-a1cd-2a6dff86e864 could not be found. Aug 02 21:47:34.735597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '5254075d-3708-4f10-a1cd-2a6dff86e864'} Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5254075d-3708-4f10-a1cd-2a6dff86e864 could not be found. Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:47:34.736378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5254075d-3708-4f10-a1cd-2a6dff86e864 could not be found. Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5254075d-3708-4f10-a1cd-2a6dff86e864 could not be found. Aug 02 21:47:34.737502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:34.738540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] Returning 404 to user: Instance 5254075d-3708-4f10-a1cd-2a6dff86e864 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:47:34.738540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7d2b236b-fee7-4421-a099-bebba4930801 tempest-ServerRescueNegativeTestJSON-1203280962 tempest-ServerRescueNegativeTestJSON-1203280962-project] 10.222.0.57 "GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864" status: 404 len: 111 microversion: 2.1 time: 0.030647 Aug 02 21:47:34.738540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 369/710] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:34 2022] GET /compute/v2.1/servers/5254075d-3708-4f10-a1cd-2a6dff86e864 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:47:34.919137 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6540b0b7-e219-4e5e-bed9-3f99c62cccfa tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:34.919674 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6540b0b7-e219-4e5e-bed9-3f99c62cccfa tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:34.926383 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6540b0b7-e219-4e5e-bed9-3f99c62cccfa tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:34.926832 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6540b0b7-e219-4e5e-bed9-3f99c62cccfa tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:34.927600 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6540b0b7-e219-4e5e-bed9-3f99c62cccfa tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:34.928703 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6540b0b7-e219-4e5e-bed9-3f99c62cccfa tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:35.175874 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6540b0b7-e219-4e5e-bed9-3f99c62cccfa tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:35.187981 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6540b0b7-e219-4e5e-bed9-3f99c62cccfa tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1577 microversion: 2.1 time: 0.272723 Aug 02 21:47:35.189339 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 342/711] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:34 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1577 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:35.472013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-dc7a7fd4-a59c-4401-ac16-aeb997c848eb req-4ff3baec-2198-4e49-ad4f-da6a2eef84fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0681fe-f330-40bb-ab1f-86772b3484e5", "name": "network-vif-deleted", "tag": "c59fcd51-2b42-4947-8a95-8e2d432d140f"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:35.472386 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-578a1d9c-0434-41e8-aa7b-8e028309589f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:35.472843 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-578a1d9c-0434-41e8-aa7b-8e028309589f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:35.481774 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-578a1d9c-0434-41e8-aa7b-8e028309589f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:35.483801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-dc7a7fd4-a59c-4401-ac16-aeb997c848eb req-4ff3baec-2198-4e49-ad4f-da6a2eef84fd service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:35.484300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-dc7a7fd4-a59c-4401-ac16-aeb997c848eb req-4ff3baec-2198-4e49-ad4f-da6a2eef84fd service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:35.487068 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-578a1d9c-0434-41e8-aa7b-8e028309589f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:35.487931 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-578a1d9c-0434-41e8-aa7b-8e028309589f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:35.488423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-578a1d9c-0434-41e8-aa7b-8e028309589f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:35.498315 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-dc7a7fd4-a59c-4401-ac16-aeb997c848eb req-4ff3baec-2198-4e49-ad4f-da6a2eef84fd service nova] Creating event network-vif-deleted:c59fcd51-2b42-4947-8a95-8e2d432d140f for instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 on hv-cinder-85144 Aug 02 21:47:35.504859 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-dc7a7fd4-a59c-4401-ac16-aeb997c848eb req-4ff3baec-2198-4e49-ad4f-da6a2eef84fd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036010 Aug 02 21:47:35.505641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 343/712] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:47:35.536939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-578a1d9c-0434-41e8-aa7b-8e028309589f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lazy-loading 'flavor' on Instance uuid 7248b87b-aba6-40d9-b464-f824c44b1672 {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:47:35.675358 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-578a1d9c-0434-41e8-aa7b-8e028309589f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "POST /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672/action" status: 202 len: 0 microversion: 2.1 time: 0.206738 Aug 02 21:47:35.676500 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 370/713] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:47:35 2022] POST /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:47:35.689292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-dfbe8bf6-33de-487b-a09c-a49f09e5d8cf tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:35.690110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-dfbe8bf6-33de-487b-a09c-a49f09e5d8cf tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:35.696652 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dfbe8bf6-33de-487b-a09c-a49f09e5d8cf tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:35.697742 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dfbe8bf6-33de-487b-a09c-a49f09e5d8cf tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:35.698788 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dfbe8bf6-33de-487b-a09c-a49f09e5d8cf tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:35.699456 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dfbe8bf6-33de-487b-a09c-a49f09e5d8cf tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:35.934173 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-dfbe8bf6-33de-487b-a09c-a49f09e5d8cf tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:35.954171 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-dfbe8bf6-33de-487b-a09c-a49f09e5d8cf tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.272532 Aug 02 21:47:35.955244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 344/714] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:35 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:36.214025 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:36.214891 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:36.224119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:36.224696 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:36.225585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:36.226114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:36.263099 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:36.263635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:36.264174 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lazy-loading 'fault' on Instance uuid 5b0681fe-f330-40bb-ab1f-86772b3484e5 {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:47:36.313177 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:36.321700 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-95970fde-83fd-409b-a1a2-971ffcc04128 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 200 len: 1230 microversion: 2.1 time: 0.114600 Aug 02 21:47:36.322672 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 371/715] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:36 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 1230 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:36.981667 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0e1b99e9-08c9-4c2c-93fc-1bff5f2c0e8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:36.982290 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0e1b99e9-08c9-4c2c-93fc-1bff5f2c0e8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:36.989199 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e1b99e9-08c9-4c2c-93fc-1bff5f2c0e8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:36.989656 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e1b99e9-08c9-4c2c-93fc-1bff5f2c0e8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:36.990438 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e1b99e9-08c9-4c2c-93fc-1bff5f2c0e8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:36.990881 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e1b99e9-08c9-4c2c-93fc-1bff5f2c0e8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:37.143871 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0e1b99e9-08c9-4c2c-93fc-1bff5f2c0e8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:37.151848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0e1b99e9-08c9-4c2c-93fc-1bff5f2c0e8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.174054 Aug 02 21:47:37.152519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 345/716] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:36 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:37.342831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:37.343386 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:37.349960 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:37.350425 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:37.351215 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:37.351665 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:37.354979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:37.367729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] HTTP exception thrown: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Request method failure captured: Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 HTTP/1.1 Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZptPXPYJJOkTdro2ctbpZWDo_p7H2ffPBrIzoqEJubOddWwfCziIes1f_134xOYicx_i06iyx32AyFYMvoveudm94WY2t7_eGdXmkPudK_cScopamekvVIcGL4SH10x34RwO3mq2XAcNwPy34fkDSmxxo7-Z-UoD3Po3uX06zjQ4mo Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:47:37.370055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 5377fd0bccf748dda1d0192080253dcf Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:47:37.371693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '5b0681fe-f330-40bb-ab1f-86772b3484e5'} Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:47:37.373088 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:47:37.374594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:37.375908 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Returning 404 to user: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:47:37.375908 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7f02d372-02d4-4cbc-be57-e054c73f193d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 404 len: 111 microversion: 2.1 time: 0.032607 Aug 02 21:47:37.375908 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 372/717] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:37 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:47:37.467505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1627158939", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-625758165", "security_groups": [{"name": "tempest-secgroup-smoke-810633011"}], "block_device_mapping_v2": [{"uuid": "49b65513-8104-439b-9d18-fc1aed90088b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3520a454-3079-4cee-a49b-0583c4633c25"}]}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:37.607147 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] validate_networks() for [('3520a454-3079-4cee-a49b-0583c4633c25', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:47:38.020736 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:47:38.021783 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:47:38.022427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:47:38.023009 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:47:38.023589 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:47:38.036385 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:38.036908 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:38.037718 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:38.038158 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:38.057648 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Getting quotas for project 0bed6dd5430c4c9983aff2e2f261f5a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:47:38.061812 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Getting quotas for user 5377fd0bccf748dda1d0192080253dcf and project 0bed6dd5430c4c9983aff2e2f261f5a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:47:38.133501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:47:38.135946 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49b65513-8104-439b-9d18-fc1aed90088b',volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:47:38.174041 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-43b63c8a-f133-46f9-94e9-2f81c4d18c84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:38.175128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-43b63c8a-f133-46f9-94e9-2f81c4d18c84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:38.182984 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-43b63c8a-f133-46f9-94e9-2f81c4d18c84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:38.183437 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-43b63c8a-f133-46f9-94e9-2f81c4d18c84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:38.184850 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-43b63c8a-f133-46f9-94e9-2f81c4d18c84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:38.184850 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-43b63c8a-f133-46f9-94e9-2f81c4d18c84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:38.361854 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-87b89d35-3cf6-4aff-9c00-e693f861608f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.898411 Aug 02 21:47:38.362515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 346/718] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:47:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 21:47:38.399157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-43b63c8a-f133-46f9-94e9-2f81c4d18c84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:38.403191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d57f0cb4-b365-4b72-b8ce-cd7585cabca4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:38.403825 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d57f0cb4-b365-4b72-b8ce-cd7585cabca4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:38.407416 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-43b63c8a-f133-46f9-94e9-2f81c4d18c84 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.238178 Aug 02 21:47:38.423476 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 373/719] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:38 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:38.482627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d57f0cb4-b365-4b72-b8ce-cd7585cabca4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:38.488795 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d57f0cb4-b365-4b72-b8ce-cd7585cabca4 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1094 microversion: 2.1 time: 0.106456 Aug 02 21:47:38.489370 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 347/720] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:38 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1094 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:39.430321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c0e7501a-206a-48db-8589-fbc75279ce65 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:39.431143 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c0e7501a-206a-48db-8589-fbc75279ce65 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:39.438119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c0e7501a-206a-48db-8589-fbc75279ce65 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:39.439395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c0e7501a-206a-48db-8589-fbc75279ce65 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:39.440258 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c0e7501a-206a-48db-8589-fbc75279ce65 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:39.440656 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c0e7501a-206a-48db-8589-fbc75279ce65 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:39.583747 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7d13157c-a2b3-4536-ad6d-9dcafdb83680 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Action: 'create', calling method: .version_select at 0x7ff552eca3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-777314257", "metadata": {"Type": "work"}}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:39.905047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c0e7501a-206a-48db-8589-fbc75279ce65 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:39.908333 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7d13157c-a2b3-4536-ad6d-9dcafdb83680 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.475334 Aug 02 21:47:39.915435 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c0e7501a-206a-48db-8589-fbc75279ce65 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.488888 Aug 02 21:47:39.916746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 348/721] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 2 21:47:39 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 484 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 02 21:47:39.926677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 374/722] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:39 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:39.928212 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7c3145ea-9353-4a5b-98f3-31f19e02ab1f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:39.929823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7c3145ea-9353-4a5b-98f3-31f19e02ab1f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:39.934354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-30c75fc2-f829-4d3a-8712-1a1e1da2952d tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Calling method '.version_select at 0x7ff552e94d30>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:39.938792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7c3145ea-9353-4a5b-98f3-31f19e02ab1f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:39.939501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7c3145ea-9353-4a5b-98f3-31f19e02ab1f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:39.940690 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7c3145ea-9353-4a5b-98f3-31f19e02ab1f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:39.941502 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7c3145ea-9353-4a5b-98f3-31f19e02ab1f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:39.989245 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-30c75fc2-f829-4d3a-8712-1a1e1da2952d tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482" status: 200 len: 352 microversion: 2.1 time: 0.061355 Aug 02 21:47:39.992171 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 375/723] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:47:39 2022] GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:40.016274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7c3145ea-9353-4a5b-98f3-31f19e02ab1f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:40.024318 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7c3145ea-9353-4a5b-98f3-31f19e02ab1f tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1210 microversion: 2.1 time: 0.106152 Aug 02 21:47:40.024821 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 349/724] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:39 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:40.937258 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f2ada627-e217-457d-8876-f399ccbd95fd tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:40.937942 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f2ada627-e217-457d-8876-f399ccbd95fd tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:40.944552 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f2ada627-e217-457d-8876-f399ccbd95fd tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:40.945011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f2ada627-e217-457d-8876-f399ccbd95fd tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:40.945791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f2ada627-e217-457d-8876-f399ccbd95fd tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:40.946234 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f2ada627-e217-457d-8876-f399ccbd95fd tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:41.003989 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-52b250ee-89d4-469c-8a74-e7ca144f668c tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Calling method '.version_select at 0x7ff552f1d5e0>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:41.055927 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-52b250ee-89d4-469c-8a74-e7ca144f668c tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482" status: 200 len: 353 microversion: 2.1 time: 0.055746 Aug 02 21:47:41.056645 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 350/725] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:47:40 2022] GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:47:41.064167 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7a4befcc-1682-4bef-a628-bad39eeab6dc tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:41.064167 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7a4befcc-1682-4bef-a628-bad39eeab6dc tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:41.068283 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7a4befcc-1682-4bef-a628-bad39eeab6dc tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:41.068809 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7a4befcc-1682-4bef-a628-bad39eeab6dc tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:41.069664 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7a4befcc-1682-4bef-a628-bad39eeab6dc tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:41.070165 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7a4befcc-1682-4bef-a628-bad39eeab6dc tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:41.156346 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f2ada627-e217-457d-8876-f399ccbd95fd tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:41.165479 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f2ada627-e217-457d-8876-f399ccbd95fd tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.232526 Aug 02 21:47:41.166329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 376/726] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:40 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:41.171121 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7aa720c3-a392-4b72-9c8e-5786224933bd tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Calling method '.version_select at 0x7ff552f6f670>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:41.215675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7a4befcc-1682-4bef-a628-bad39eeab6dc tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:41.221727 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7aa720c3-a392-4b72-9c8e-5786224933bd tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482" status: 200 len: 353 microversion: 2.1 time: 0.054161 Aug 02 21:47:41.222295 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 377/727] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:47:41 2022] GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:41.226475 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7a4befcc-1682-4bef-a628-bad39eeab6dc tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.168706 Aug 02 21:47:41.227325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 351/728] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:41 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:41.239423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-47bef428-7780-4778-b893-3209cfcb7ea5 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Calling method '.version_select at 0x7ff55b7b4310>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:41.266077 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-813a918a-6cab-48ba-b138-8b98eafd9c48 req-6d4b6400-9030-4d54-99af-63e4e7d0c233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ddda1b-801a-438b-a86c-df7d1340dfba", "tag": "65ee788b-1995-470a-8bd3-2409d32094e5"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:41.280758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-813a918a-6cab-48ba-b138-8b98eafd9c48 req-6d4b6400-9030-4d54-99af-63e4e7d0c233 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:41.281339 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-813a918a-6cab-48ba-b138-8b98eafd9c48 req-6d4b6400-9030-4d54-99af-63e4e7d0c233 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:41.294635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-813a918a-6cab-48ba-b138-8b98eafd9c48 req-6d4b6400-9030-4d54-99af-63e4e7d0c233 service nova] Creating event network-changed:65ee788b-1995-470a-8bd3-2409d32094e5 for instance 43ddda1b-801a-438b-a86c-df7d1340dfba on hv-cinder-85144 Aug 02 21:47:41.300802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-813a918a-6cab-48ba-b138-8b98eafd9c48 req-6d4b6400-9030-4d54-99af-63e4e7d0c233 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041249 Aug 02 21:47:41.301730 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 352/729] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:47:41.315273 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-47bef428-7780-4778-b893-3209cfcb7ea5 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482" status: 202 len: 0 microversion: 2.1 time: 0.079788 Aug 02 21:47:41.316963 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 378/730] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:47:41 2022] DELETE /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:47:41.325287 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-79a04bb0-237d-4714-abeb-bb72bd36f01b tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Calling method '.version_select at 0x7ff552d84f70>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:41.374751 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-79a04bb0-237d-4714-abeb-bb72bd36f01b tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482" status: 200 len: 352 microversion: 2.1 time: 0.054235 Aug 02 21:47:41.375393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 353/731] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:47:41 2022] GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:47:42.187863 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-463cb0f2-a5e0-4133-9b79-5b6bc60649c8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:42.188405 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-463cb0f2-a5e0-4133-9b79-5b6bc60649c8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:42.194973 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-463cb0f2-a5e0-4133-9b79-5b6bc60649c8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:42.195428 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-463cb0f2-a5e0-4133-9b79-5b6bc60649c8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:42.196232 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-463cb0f2-a5e0-4133-9b79-5b6bc60649c8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:42.197336 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-463cb0f2-a5e0-4133-9b79-5b6bc60649c8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:42.255346 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e598ac8e-42b0-41e6-830b-98515d47e227 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:42.256234 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e598ac8e-42b0-41e6-830b-98515d47e227 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:42.263126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e598ac8e-42b0-41e6-830b-98515d47e227 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:42.263652 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e598ac8e-42b0-41e6-830b-98515d47e227 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:42.264515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e598ac8e-42b0-41e6-830b-98515d47e227 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:42.265056 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e598ac8e-42b0-41e6-830b-98515d47e227 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:42.341807 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-463cb0f2-a5e0-4133-9b79-5b6bc60649c8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:42.349460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-463cb0f2-a5e0-4133-9b79-5b6bc60649c8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.166298 Aug 02 21:47:42.350133 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 379/732] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:42 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:42.388942 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-01c1cc5a-7ca7-4278-ab07-787e53496443 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Calling method '.version_select at 0x7ff552fa7dc0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:42.398773 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e598ac8e-42b0-41e6-830b-98515d47e227 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:42.407153 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e598ac8e-42b0-41e6-830b-98515d47e227 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.156164 Aug 02 21:47:42.408173 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 354/733] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:42 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:42.418448 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-01c1cc5a-7ca7-4278-ab07-787e53496443 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] HTTP exception thrown: Volume e7de0ea1-6e17-4117-8199-d8c182327482 could not be found. Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-01c1cc5a-7ca7-4278-ab07-787e53496443 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Request method failure captured: Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482 HTTP/1.1 Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zt7ZCqGZrguvQAGA_vP2rZTSuWcyMxX9HN4k79Tkgah9Nv4TEPhpnE1EubCDfnquw8JKBgueaau-ULENvQsWz_HtCmwlw2eDl-VOcrnWhJahDyNHmo8628dSB7ZpuLSyW6OMuDaLNtDT3B18cOvGnSVSiKkp_y5gw-iNqrjdmDsHGY Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 2e46e89fc6564fe1ac8d957eea188b26 Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesGetTestJSON-1481147453 Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:47:42.420935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e46e89fc6564fe1ac8d957eea188b26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e46e89fc6564fe1ac8d957eea188b26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e46e89fc6564fe1ac8d957eea188b26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e46e89fc6564fe1ac8d957eea188b26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesGetTestJSON-1481147453 Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 2e46e89fc6564fe1ac8d957eea188b26 Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesGetTestJSON-1481147453 Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesGetTestJSON-1481147453-project Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: d555451425bd42f1b62159d9a7c09837 Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesGetTestJSON-1481147453-project Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Volume e7de0ea1-6e17-4117-8199-d8c182327482 could not be found. Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'e7de0ea1-6e17-4117-8199-d8c182327482'} Aug 02 21:47:42.422526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7de0ea1-6e17-4117-8199-d8c182327482 could not be found. (HTTP 404) (Request-ID: req-6d5a7418-e608-4a53-bb47-72b5f701428b) Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:42.423447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:47:42.424857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7de0ea1-6e17-4117-8199-d8c182327482 could not be found. Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 21:47:42.426164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7de0ea1-6e17-4117-8199-d8c182327482 could not be found. Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7de0ea1-6e17-4117-8199-d8c182327482 could not be found. Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-01c1cc5a-7ca7-4278-ab07-787e53496443 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] Returning 404 to user: Volume e7de0ea1-6e17-4117-8199-d8c182327482 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-01c1cc5a-7ca7-4278-ab07-787e53496443 tempest-VolumesGetTestJSON-1481147453 tempest-VolumesGetTestJSON-1481147453-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482" status: 404 len: 109 microversion: 2.1 time: 0.037281 Aug 02 21:47:42.427563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 380/734] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:47:42 2022] GET /compute/v2.1/os-volumes/e7de0ea1-6e17-4117-8199-d8c182327482 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 21:47:43.370315 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0e099032-bd70-4724-b835-e186c7fd6d1b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:43.370933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0e099032-bd70-4724-b835-e186c7fd6d1b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:43.377555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e099032-bd70-4724-b835-e186c7fd6d1b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:43.378012 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e099032-bd70-4724-b835-e186c7fd6d1b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:43.378792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e099032-bd70-4724-b835-e186c7fd6d1b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:43.379244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0e099032-bd70-4724-b835-e186c7fd6d1b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:43.428989 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-98acfd90-7a69-42a5-9c58-26f4d36d606a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:43.430241 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-98acfd90-7a69-42a5-9c58-26f4d36d606a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:43.438390 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-98acfd90-7a69-42a5-9c58-26f4d36d606a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:43.439187 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-98acfd90-7a69-42a5-9c58-26f4d36d606a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:43.440148 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-98acfd90-7a69-42a5-9c58-26f4d36d606a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:43.440742 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-98acfd90-7a69-42a5-9c58-26f4d36d606a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:43.539465 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0e099032-bd70-4724-b835-e186c7fd6d1b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:43.550188 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0e099032-bd70-4724-b835-e186c7fd6d1b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.183646 Aug 02 21:47:43.551084 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 355/735] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:43 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:43.593307 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-98acfd90-7a69-42a5-9c58-26f4d36d606a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:43.600824 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-98acfd90-7a69-42a5-9c58-26f4d36d606a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.176211 Aug 02 21:47:43.602692 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 381/736] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:43 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:44.571141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f938edf6-0d0d-4602-b91b-dfe98641849c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:44.572402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f938edf6-0d0d-4602-b91b-dfe98641849c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:44.578898 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f938edf6-0d0d-4602-b91b-dfe98641849c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:44.582493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f938edf6-0d0d-4602-b91b-dfe98641849c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:44.582493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f938edf6-0d0d-4602-b91b-dfe98641849c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:44.582493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f938edf6-0d0d-4602-b91b-dfe98641849c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:44.622628 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-53791168-3c27-4f2d-a809-aa4be7782cd6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:44.623323 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-53791168-3c27-4f2d-a809-aa4be7782cd6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:44.630061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-53791168-3c27-4f2d-a809-aa4be7782cd6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:44.630518 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-53791168-3c27-4f2d-a809-aa4be7782cd6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:44.631293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-53791168-3c27-4f2d-a809-aa4be7782cd6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:44.631744 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-53791168-3c27-4f2d-a809-aa4be7782cd6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:44.733928 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f938edf6-0d0d-4602-b91b-dfe98641849c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:44.736592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:44.743880 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f938edf6-0d0d-4602-b91b-dfe98641849c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.176217 Aug 02 21:47:44.744879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 356/737] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:44 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:44.781949 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-53791168-3c27-4f2d-a809-aa4be7782cd6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:44.789533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-53791168-3c27-4f2d-a809-aa4be7782cd6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.171446 Aug 02 21:47:44.790611 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 382/738] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:44 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:45.766540 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b1c34aed-735f-4ca9-8af3-3adfe436b19f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:45.767158 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b1c34aed-735f-4ca9-8af3-3adfe436b19f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:45.775128 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b1c34aed-735f-4ca9-8af3-3adfe436b19f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:45.775580 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b1c34aed-735f-4ca9-8af3-3adfe436b19f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:45.776372 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b1c34aed-735f-4ca9-8af3-3adfe436b19f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:45.776924 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b1c34aed-735f-4ca9-8af3-3adfe436b19f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:45.815327 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b7addb70-86c3-4cab-8f35-4f03c9d9b448 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:45.817028 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b7addb70-86c3-4cab-8f35-4f03c9d9b448 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:45.823967 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7addb70-86c3-4cab-8f35-4f03c9d9b448 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:45.824531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7addb70-86c3-4cab-8f35-4f03c9d9b448 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:45.825326 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7addb70-86c3-4cab-8f35-4f03c9d9b448 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:45.825762 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7addb70-86c3-4cab-8f35-4f03c9d9b448 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:45.930622 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b1c34aed-735f-4ca9-8af3-3adfe436b19f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:45.939634 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b1c34aed-735f-4ca9-8af3-3adfe436b19f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.177580 Aug 02 21:47:45.942052 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 357/739] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:45 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:45.999047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b7addb70-86c3-4cab-8f35-4f03c9d9b448 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:46.007060 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b7addb70-86c3-4cab-8f35-4f03c9d9b448 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.198424 Aug 02 21:47:46.007634 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 383/740] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:45 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:46.965417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-dd7f7d23-d51a-4396-9ed8-36c0565f07d8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:46.966006 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-dd7f7d23-d51a-4396-9ed8-36c0565f07d8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:46.973038 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dd7f7d23-d51a-4396-9ed8-36c0565f07d8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:46.973489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dd7f7d23-d51a-4396-9ed8-36c0565f07d8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:46.974249 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dd7f7d23-d51a-4396-9ed8-36c0565f07d8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:46.974843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-dd7f7d23-d51a-4396-9ed8-36c0565f07d8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:47.029339 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5a8381ae-c00d-41c4-a812-30bfc0607758 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:47.030492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5a8381ae-c00d-41c4-a812-30bfc0607758 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:47.037275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a8381ae-c00d-41c4-a812-30bfc0607758 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:47.037736 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a8381ae-c00d-41c4-a812-30bfc0607758 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:47.038651 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a8381ae-c00d-41c4-a812-30bfc0607758 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:47.039302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5a8381ae-c00d-41c4-a812-30bfc0607758 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:47.125272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-dd7f7d23-d51a-4396-9ed8-36c0565f07d8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:47.134141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-dd7f7d23-d51a-4396-9ed8-36c0565f07d8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.173991 Aug 02 21:47:47.134965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 358/741] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:46 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:47.180053 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5a8381ae-c00d-41c4-a812-30bfc0607758 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:47.187463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5a8381ae-c00d-41c4-a812-30bfc0607758 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.162851 Aug 02 21:47:47.188034 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 384/742] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:47 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:48.155723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-543bdcac-84be-4e3f-8ce2-38eaf8e83783 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:48.156406 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-543bdcac-84be-4e3f-8ce2-38eaf8e83783 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:48.158786 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:48.164192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-543bdcac-84be-4e3f-8ce2-38eaf8e83783 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:48.164642 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-543bdcac-84be-4e3f-8ce2-38eaf8e83783 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:48.166232 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-543bdcac-84be-4e3f-8ce2-38eaf8e83783 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:48.166663 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-543bdcac-84be-4e3f-8ce2-38eaf8e83783 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:48.208020 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f065e63e-1b21-4c94-bc04-5b0cd0d81a68 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:48.208712 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f065e63e-1b21-4c94-bc04-5b0cd0d81a68 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:48.215943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f065e63e-1b21-4c94-bc04-5b0cd0d81a68 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:48.216435 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f065e63e-1b21-4c94-bc04-5b0cd0d81a68 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:48.217249 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f065e63e-1b21-4c94-bc04-5b0cd0d81a68 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:48.217745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f065e63e-1b21-4c94-bc04-5b0cd0d81a68 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:48.327161 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-543bdcac-84be-4e3f-8ce2-38eaf8e83783 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:48.335706 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-543bdcac-84be-4e3f-8ce2-38eaf8e83783 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.183848 Aug 02 21:47:48.336318 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 359/743] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:48 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:48.364688 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f065e63e-1b21-4c94-bc04-5b0cd0d81a68 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:48.372063 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f065e63e-1b21-4c94-bc04-5b0cd0d81a68 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.167861 Aug 02 21:47:48.372857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 385/744] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:48 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:49.357598 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1bccd436-2504-4345-95f8-5d5d0171066b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:49.358245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1bccd436-2504-4345-95f8-5d5d0171066b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:49.360065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=8 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:49.366112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1bccd436-2504-4345-95f8-5d5d0171066b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:49.366512 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1bccd436-2504-4345-95f8-5d5d0171066b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:49.367281 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1bccd436-2504-4345-95f8-5d5d0171066b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:49.367723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1bccd436-2504-4345-95f8-5d5d0171066b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:49.393803 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-be1a7fc3-9cc7-418d-ac41-d62143798c16 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:49.394780 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-be1a7fc3-9cc7-418d-ac41-d62143798c16 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:49.401817 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be1a7fc3-9cc7-418d-ac41-d62143798c16 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:49.402243 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be1a7fc3-9cc7-418d-ac41-d62143798c16 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:49.403361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be1a7fc3-9cc7-418d-ac41-d62143798c16 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:49.403872 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be1a7fc3-9cc7-418d-ac41-d62143798c16 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:49.518785 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1bccd436-2504-4345-95f8-5d5d0171066b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:49.527394 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1bccd436-2504-4345-95f8-5d5d0171066b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.173518 Aug 02 21:47:49.527976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 360/745] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:49 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:49.566487 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-be1a7fc3-9cc7-418d-ac41-d62143798c16 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:49.580320 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-be1a7fc3-9cc7-418d-ac41-d62143798c16 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.190383 Aug 02 21:47:49.581058 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 386/746] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:49 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:50.548894 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-edf508b3-7375-479d-ad6a-9b0c96829693 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:50.549514 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-edf508b3-7375-479d-ad6a-9b0c96829693 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:50.556020 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-edf508b3-7375-479d-ad6a-9b0c96829693 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:50.556521 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-edf508b3-7375-479d-ad6a-9b0c96829693 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:50.557293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-edf508b3-7375-479d-ad6a-9b0c96829693 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:50.557740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-edf508b3-7375-479d-ad6a-9b0c96829693 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:50.604224 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5b0b25b7-2615-42f0-8028-8a1096ea0973 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:50.605635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5b0b25b7-2615-42f0-8028-8a1096ea0973 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:50.612199 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5b0b25b7-2615-42f0-8028-8a1096ea0973 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:50.612740 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5b0b25b7-2615-42f0-8028-8a1096ea0973 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:50.613701 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5b0b25b7-2615-42f0-8028-8a1096ea0973 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:50.614144 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5b0b25b7-2615-42f0-8028-8a1096ea0973 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:50.694779 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-edf508b3-7375-479d-ad6a-9b0c96829693 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:50.710839 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-edf508b3-7375-479d-ad6a-9b0c96829693 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1506 microversion: 2.1 time: 0.165677 Aug 02 21:47:50.711429 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 361/747] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:50 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:50.731897 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-716c7071-0c0b-4b0a-a925-6fa182e3c2f3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:50.732721 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-716c7071-0c0b-4b0a-a925-6fa182e3c2f3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:50.738893 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-716c7071-0c0b-4b0a-a925-6fa182e3c2f3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:50.739344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-716c7071-0c0b-4b0a-a925-6fa182e3c2f3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:50.740367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-716c7071-0c0b-4b0a-a925-6fa182e3c2f3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:50.740977 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-716c7071-0c0b-4b0a-a925-6fa182e3c2f3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:50.792051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-716c7071-0c0b-4b0a-a925-6fa182e3c2f3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124840) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 21:47:50.793466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5b0b25b7-2615-42f0-8028-8a1096ea0973 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:50.801384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5b0b25b7-2615-42f0-8028-8a1096ea0973 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.201835 Aug 02 21:47:50.813077 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 387/748] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:50 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:50.878833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-716c7071-0c0b-4b0a-a925-6fa182e3c2f3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "POST /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672/action" status: 202 len: 0 microversion: 2.1 time: 0.150966 Aug 02 21:47:50.880207 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 362/749] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:47:50 2022] POST /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 21:47:50.889550 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9c6dc195-5999-4136-9885-7d6075225f36 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:50.891611 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9c6dc195-5999-4136-9885-7d6075225f36 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:50.898163 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c6dc195-5999-4136-9885-7d6075225f36 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:50.898850 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c6dc195-5999-4136-9885-7d6075225f36 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:50.900722 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c6dc195-5999-4136-9885-7d6075225f36 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:50.901155 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c6dc195-5999-4136-9885-7d6075225f36 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:51.095556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9c6dc195-5999-4136-9885-7d6075225f36 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:51.103737 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9c6dc195-5999-4136-9885-7d6075225f36 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1514 microversion: 2.1 time: 0.220210 Aug 02 21:47:51.104397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 388/750] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:50 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:51.823407 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e2a01e16-f0d2-4ef9-85b5-08898fc2d8bd tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:51.824026 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e2a01e16-f0d2-4ef9-85b5-08898fc2d8bd tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:51.830167 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2a01e16-f0d2-4ef9-85b5-08898fc2d8bd tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:51.830624 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2a01e16-f0d2-4ef9-85b5-08898fc2d8bd tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:51.831439 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2a01e16-f0d2-4ef9-85b5-08898fc2d8bd tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:51.831834 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2a01e16-f0d2-4ef9-85b5-08898fc2d8bd tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:51.972273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e2a01e16-f0d2-4ef9-85b5-08898fc2d8bd tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:51.982194 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e2a01e16-f0d2-4ef9-85b5-08898fc2d8bd tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.163212 Aug 02 21:47:51.983314 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 363/751] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:51 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:52.052245 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-7e9ee30c-d581-47af-845f-955136940bde req-263c8053-49a8-4a3e-8e3b-8db3cde34598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ddda1b-801a-438b-a86c-df7d1340dfba", "name": "network-vif-plugged", "status": "completed", "tag": "65ee788b-1995-470a-8bd3-2409d32094e5"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:52.066311 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7e9ee30c-d581-47af-845f-955136940bde req-263c8053-49a8-4a3e-8e3b-8db3cde34598 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:52.066965 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7e9ee30c-d581-47af-845f-955136940bde req-263c8053-49a8-4a3e-8e3b-8db3cde34598 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:52.080922 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-7e9ee30c-d581-47af-845f-955136940bde req-263c8053-49a8-4a3e-8e3b-8db3cde34598 service nova] Creating event network-vif-plugged:65ee788b-1995-470a-8bd3-2409d32094e5 for instance 43ddda1b-801a-438b-a86c-df7d1340dfba on hv-cinder-85144 Aug 02 21:47:52.086453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-7e9ee30c-d581-47af-845f-955136940bde req-263c8053-49a8-4a3e-8e3b-8db3cde34598 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038203 Aug 02 21:47:52.087585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 389/752] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:52.125305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-71f8b1a0-6fc9-40c9-b9ee-30ba72560179 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:52.125920 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-71f8b1a0-6fc9-40c9-b9ee-30ba72560179 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:52.128784 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:52.132942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-71f8b1a0-6fc9-40c9-b9ee-30ba72560179 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:52.133454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-71f8b1a0-6fc9-40c9-b9ee-30ba72560179 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:52.134513 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-71f8b1a0-6fc9-40c9-b9ee-30ba72560179 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:52.134997 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-71f8b1a0-6fc9-40c9-b9ee-30ba72560179 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:52.328976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-71f8b1a0-6fc9-40c9-b9ee-30ba72560179 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:52.347628 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-71f8b1a0-6fc9-40c9-b9ee-30ba72560179 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1516 microversion: 2.1 time: 0.225359 Aug 02 21:47:52.351823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 364/753] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:52 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:53.005559 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-16fb328e-97cd-4ac9-a9cc-40b88411bbc8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:53.006261 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-16fb328e-97cd-4ac9-a9cc-40b88411bbc8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:53.012536 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16fb328e-97cd-4ac9-a9cc-40b88411bbc8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:53.012989 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16fb328e-97cd-4ac9-a9cc-40b88411bbc8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:53.013757 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16fb328e-97cd-4ac9-a9cc-40b88411bbc8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:53.014202 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16fb328e-97cd-4ac9-a9cc-40b88411bbc8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:53.146964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-16fb328e-97cd-4ac9-a9cc-40b88411bbc8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:53.154486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-16fb328e-97cd-4ac9-a9cc-40b88411bbc8 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.153177 Aug 02 21:47:53.155137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 390/754] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:52 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:53.373343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-293f7e1e-d927-48a8-ad40-82397672b3c1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:53.373885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-293f7e1e-d927-48a8-ad40-82397672b3c1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:53.380290 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-293f7e1e-d927-48a8-ad40-82397672b3c1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:53.380741 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-293f7e1e-d927-48a8-ad40-82397672b3c1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:53.381497 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-293f7e1e-d927-48a8-ad40-82397672b3c1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:53.381930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-293f7e1e-d927-48a8-ad40-82397672b3c1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:53.520270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-293f7e1e-d927-48a8-ad40-82397672b3c1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:53.529104 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-293f7e1e-d927-48a8-ad40-82397672b3c1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.159745 Aug 02 21:47:53.529976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 365/755] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:53 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:53.997307 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5b959f0c-c081-4eb4-b08f-dc46da934def tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:54.000287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5b959f0c-c081-4eb4-b08f-dc46da934def tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:54.006578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5b959f0c-c081-4eb4-b08f-dc46da934def tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.007035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5b959f0c-c081-4eb4-b08f-dc46da934def tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.007849 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5b959f0c-c081-4eb4-b08f-dc46da934def tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.008844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5b959f0c-c081-4eb4-b08f-dc46da934def tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.045181 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5b959f0c-c081-4eb4-b08f-dc46da934def tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053033 Aug 02 21:47:54.046012 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 391/756] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:47:53 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:47:54.121137 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-1286373a-85eb-4f52-be1d-d6f1521c0c50 req-aa08a53a-4cc7-4d52-896b-06957fddf244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7248b87b-aba6-40d9-b464-f824c44b1672", "name": "network-vif-unplugged", "status": "completed", "tag": "5a4b7f07-13e7-408e-b7d9-3162f37424ed"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:54.125176 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3cd5f6fb-6852-4606-a976-f607356be51b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:54.125680 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3cd5f6fb-6852-4606-a976-f607356be51b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:54.131333 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-1286373a-85eb-4f52-be1d-d6f1521c0c50 req-aa08a53a-4cc7-4d52-896b-06957fddf244 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.131741 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-1286373a-85eb-4f52-be1d-d6f1521c0c50 req-aa08a53a-4cc7-4d52-896b-06957fddf244 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.138092 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3cd5f6fb-6852-4606-a976-f607356be51b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.138964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3cd5f6fb-6852-4606-a976-f607356be51b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.139772 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3cd5f6fb-6852-4606-a976-f607356be51b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.140230 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3cd5f6fb-6852-4606-a976-f607356be51b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.145055 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-1286373a-85eb-4f52-be1d-d6f1521c0c50 req-aa08a53a-4cc7-4d52-896b-06957fddf244 service nova] Creating event network-vif-unplugged:5a4b7f07-13e7-408e-b7d9-3162f37424ed for instance 7248b87b-aba6-40d9-b464-f824c44b1672 on hv-cinder-85144 Aug 02 21:47:54.150545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-1286373a-85eb-4f52-be1d-d6f1521c0c50 req-aa08a53a-4cc7-4d52-896b-06957fddf244 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033508 Aug 02 21:47:54.151433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 366/757] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:54.179255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7e0bc971-1eae-4b05-86f6-a353ddb0ae37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:54.180979 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7e0bc971-1eae-4b05-86f6-a353ddb0ae37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:54.181436 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3cd5f6fb-6852-4606-a976-f607356be51b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:47:54.197778 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e0bc971-1eae-4b05-86f6-a353ddb0ae37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.198632 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e0bc971-1eae-4b05-86f6-a353ddb0ae37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.199908 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e0bc971-1eae-4b05-86f6-a353ddb0ae37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.200527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e0bc971-1eae-4b05-86f6-a353ddb0ae37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.237423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:54.272766 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3cd5f6fb-6852-4606-a976-f607356be51b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 204 len: 0 microversion: 2.1 time: 0.151152 Aug 02 21:47:54.273487 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 392/758] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:47:54 2022] DELETE /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:47:54.284492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a5bcc0f2-e434-4ede-94fb-f629124f56e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:54.285977 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a5bcc0f2-e434-4ede-94fb-f629124f56e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:54.293657 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a5bcc0f2-e434-4ede-94fb-f629124f56e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.294238 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a5bcc0f2-e434-4ede-94fb-f629124f56e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.295365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a5bcc0f2-e434-4ede-94fb-f629124f56e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.295932 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a5bcc0f2-e434-4ede-94fb-f629124f56e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.383428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7e0bc971-1eae-4b05-86f6-a353ddb0ae37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:54.393466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7e0bc971-1eae-4b05-86f6-a353ddb0ae37 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1265 microversion: 2.1 time: 0.218972 Aug 02 21:47:54.394052 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 367/759] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:54 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:54.472390 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a5bcc0f2-e434-4ede-94fb-f629124f56e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:54.483297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a5bcc0f2-e434-4ede-94fb-f629124f56e9 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1673 microversion: 2.1 time: 0.205277 Aug 02 21:47:54.483867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 393/760] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:54 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:54.550646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-29b92818-4f1f-4510-8e3b-0016e6bc10f7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:54.551300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-29b92818-4f1f-4510-8e3b-0016e6bc10f7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:54.557771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-29b92818-4f1f-4510-8e3b-0016e6bc10f7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.558216 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-29b92818-4f1f-4510-8e3b-0016e6bc10f7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.559138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-29b92818-4f1f-4510-8e3b-0016e6bc10f7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:54.559519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-29b92818-4f1f-4510-8e3b-0016e6bc10f7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:54.688719 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-29b92818-4f1f-4510-8e3b-0016e6bc10f7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:54.696212 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-29b92818-4f1f-4510-8e3b-0016e6bc10f7 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.149423 Aug 02 21:47:54.696772 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 368/761] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:54 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:55.414951 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-00a63e37-9af8-4b0e-8f07-ce1cfdbe0ae5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:55.415570 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-00a63e37-9af8-4b0e-8f07-ce1cfdbe0ae5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:55.418067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:55.423562 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-00a63e37-9af8-4b0e-8f07-ce1cfdbe0ae5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:55.424035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-00a63e37-9af8-4b0e-8f07-ce1cfdbe0ae5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:55.424811 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-00a63e37-9af8-4b0e-8f07-ce1cfdbe0ae5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:55.425253 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-00a63e37-9af8-4b0e-8f07-ce1cfdbe0ae5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:55.505404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d332d59f-b30c-4de5-b41e-a78107097036 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:55.506028 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d332d59f-b30c-4de5-b41e-a78107097036 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:55.512961 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d332d59f-b30c-4de5-b41e-a78107097036 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:55.513419 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d332d59f-b30c-4de5-b41e-a78107097036 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:55.514200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d332d59f-b30c-4de5-b41e-a78107097036 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:55.514650 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d332d59f-b30c-4de5-b41e-a78107097036 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:55.567471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-00a63e37-9af8-4b0e-8f07-ce1cfdbe0ae5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:55.575736 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-00a63e37-9af8-4b0e-8f07-ce1cfdbe0ae5 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1452 microversion: 2.1 time: 0.165046 Aug 02 21:47:55.592385 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 394/762] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:55 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:55.597469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a19962c4-5fef-4b54-9461-6d7350a6fe21 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:55.598488 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a19962c4-5fef-4b54-9461-6d7350a6fe21 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:55.605273 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a19962c4-5fef-4b54-9461-6d7350a6fe21 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:55.608287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a19962c4-5fef-4b54-9461-6d7350a6fe21 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:55.609347 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a19962c4-5fef-4b54-9461-6d7350a6fe21 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:55.610130 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a19962c4-5fef-4b54-9461-6d7350a6fe21 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:55.682537 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d332d59f-b30c-4de5-b41e-a78107097036 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:55.690687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d332d59f-b30c-4de5-b41e-a78107097036 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1673 microversion: 2.1 time: 0.189299 Aug 02 21:47:55.691482 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 369/763] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:55 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:55.718871 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ce89c2b8-6934-4e86-bbbf-3f5b8d285f30 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:55.719728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ce89c2b8-6934-4e86-bbbf-3f5b8d285f30 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:55.726350 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ce89c2b8-6934-4e86-bbbf-3f5b8d285f30 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:55.727680 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ce89c2b8-6934-4e86-bbbf-3f5b8d285f30 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:55.728676 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ce89c2b8-6934-4e86-bbbf-3f5b8d285f30 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:55.729118 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ce89c2b8-6934-4e86-bbbf-3f5b8d285f30 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:55.840598 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a19962c4-5fef-4b54-9461-6d7350a6fe21 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:55.848415 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a19962c4-5fef-4b54-9461-6d7350a6fe21 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1452 microversion: 2.1 time: 0.254670 Aug 02 21:47:55.848983 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 395/764] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:55 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1452 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:55.899301 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-ce89c2b8-6934-4e86-bbbf-3f5b8d285f30 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:55.907845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ce89c2b8-6934-4e86-bbbf-3f5b8d285f30 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.193547 Aug 02 21:47:55.908328 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 370/765] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:55 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:47:56.713058 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f80555c6-c3f5-449e-ac2e-40cc72e657fb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:56.713743 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f80555c6-c3f5-449e-ac2e-40cc72e657fb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:56.720769 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f80555c6-c3f5-449e-ac2e-40cc72e657fb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:56.721276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f80555c6-c3f5-449e-ac2e-40cc72e657fb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:56.722160 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f80555c6-c3f5-449e-ac2e-40cc72e657fb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:56.722603 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f80555c6-c3f5-449e-ac2e-40cc72e657fb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:56.877762 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f80555c6-c3f5-449e-ac2e-40cc72e657fb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:56.887356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f80555c6-c3f5-449e-ac2e-40cc72e657fb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1673 microversion: 2.1 time: 0.179079 Aug 02 21:47:56.888223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 396/766] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:56 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:56.930649 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fd3d1d34-b8f0-43de-8567-b6b125f7b2df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:56.931517 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fd3d1d34-b8f0-43de-8567-b6b125f7b2df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:56.938183 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fd3d1d34-b8f0-43de-8567-b6b125f7b2df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:56.938761 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fd3d1d34-b8f0-43de-8567-b6b125f7b2df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:56.939644 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fd3d1d34-b8f0-43de-8567-b6b125f7b2df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:56.940215 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fd3d1d34-b8f0-43de-8567-b6b125f7b2df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:57.237412 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fd3d1d34-b8f0-43de-8567-b6b125f7b2df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:57.245843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fd3d1d34-b8f0-43de-8567-b6b125f7b2df tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.319515 Aug 02 21:47:57.247044 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 371/767] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:56 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:57.814276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-9e2ad9eb-d635-477f-abc1-11058d1e44df req-b4848d0b-ef07-4bdb-86fa-685391db0e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29658748-1966-42f3-9fec-c72df8ee883d", "name": "network-vif-deleted", "tag": "9519b829-ec58-4b2f-a032-377ada1ca4aa"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:47:57.827044 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-9e2ad9eb-d635-477f-abc1-11058d1e44df req-b4848d0b-ef07-4bdb-86fa-685391db0e59 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:57.827901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-9e2ad9eb-d635-477f-abc1-11058d1e44df req-b4848d0b-ef07-4bdb-86fa-685391db0e59 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:57.842874 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-9e2ad9eb-d635-477f-abc1-11058d1e44df req-b4848d0b-ef07-4bdb-86fa-685391db0e59 service nova] Creating event network-vif-deleted:9519b829-ec58-4b2f-a032-377ada1ca4aa for instance 29658748-1966-42f3-9fec-c72df8ee883d on hv-cinder-85144 Aug 02 21:47:57.848820 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-9e2ad9eb-d635-477f-abc1-11058d1e44df req-b4848d0b-ef07-4bdb-86fa-685391db0e59 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037864 Aug 02 21:47:57.850119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 397/768] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:47:57.911616 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-eb48f8bc-f209-45a6-aa56-c964b75a6e7d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:57.912245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-eb48f8bc-f209-45a6-aa56-c964b75a6e7d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:57.927596 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eb48f8bc-f209-45a6-aa56-c964b75a6e7d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:57.928320 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eb48f8bc-f209-45a6-aa56-c964b75a6e7d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:57.941146 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eb48f8bc-f209-45a6-aa56-c964b75a6e7d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:57.943697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eb48f8bc-f209-45a6-aa56-c964b75a6e7d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:58.065101 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-eb48f8bc-f209-45a6-aa56-c964b75a6e7d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:58.079397 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-eb48f8bc-f209-45a6-aa56-c964b75a6e7d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 200 len: 1322 microversion: 2.1 time: 0.172402 Aug 02 21:47:58.082934 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 372/769] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:57 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:58.268585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-12e1b5fd-c1eb-41a7-8292-2d8b45d2bae4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:58.269831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-12e1b5fd-c1eb-41a7-8292-2d8b45d2bae4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:58.278312 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-12e1b5fd-c1eb-41a7-8292-2d8b45d2bae4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:58.281335 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-12e1b5fd-c1eb-41a7-8292-2d8b45d2bae4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:58.282297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-12e1b5fd-c1eb-41a7-8292-2d8b45d2bae4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:58.282939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-12e1b5fd-c1eb-41a7-8292-2d8b45d2bae4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:58.546856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-12e1b5fd-c1eb-41a7-8292-2d8b45d2bae4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:58.556651 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-12e1b5fd-c1eb-41a7-8292-2d8b45d2bae4 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.293432 Aug 02 21:47:58.557236 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 398/770] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:58 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:47:59.103036 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:59.104250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:59.111037 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:59.111759 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:59.112575 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:59.113015 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:59.117591 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:59.135073 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] HTTP exception thrown: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Request method failure captured: Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d HTTP/1.1 Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm4PJks9DGp_XsP_qbfZ7_XzDTbGiSaM3ICbo1GgA-9nAF2EphKBkxxKUY8V_ADFW2rWQ_y5i7RnWLM1ArDOD1LoHgm5ObhxQow_8cnehSD3JYihs-PXo2YYaCbYYss-qMyiy2J6CWMUeYce2GTo0Ukeacn3MXFNQl5zjO6mPJ8UD8 Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:47:59.136914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 3d13a56d271447bb936cea12e693b22f Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:47:59.138174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '29658748-1966-42f3-9fec-c72df8ee883d'} Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:47:59.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:47:59.140125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:47:59.141239 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Returning 404 to user: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:47:59.141239 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e7ccc554-8442-4618-9d61-272d2f7d3271 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 404 len: 111 microversion: 2.1 time: 0.039262 Aug 02 21:47:59.141239 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 373/771] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:59 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:47:59.151325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-907207a3-410e-4a80-9e5d-ac440187c740 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '.version_select at 0x7ff55b812280>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:59.175660 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-907207a3-410e-4a80-9e5d-ac440187c740 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422581794" status: 202 len: 0 microversion: 2.1 time: 0.029080 Aug 02 21:47:59.176531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 399/772] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 2 21:47:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422581794 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:47:59.583281 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0eff43d9-75d3-4bc4-8953-8a81e08cc38b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:47:59.583921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0eff43d9-75d3-4bc4-8953-8a81e08cc38b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:47:59.599405 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0eff43d9-75d3-4bc4-8953-8a81e08cc38b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:59.599855 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0eff43d9-75d3-4bc4-8953-8a81e08cc38b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:59.600680 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0eff43d9-75d3-4bc4-8953-8a81e08cc38b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:47:59.601121 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0eff43d9-75d3-4bc4-8953-8a81e08cc38b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:47:59.773717 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0eff43d9-75d3-4bc4-8953-8a81e08cc38b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:47:59.784877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0eff43d9-75d3-4bc4-8953-8a81e08cc38b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.208200 Aug 02 21:47:59.785556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 374/773] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:47:59 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:00.035691 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-66e8e6f8-d4b4-4f57-913b-78a68eff6dee req-ce56ac5d-f4f1-4a63-aff1-7da0ac72372a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ddda1b-801a-438b-a86c-df7d1340dfba", "tag": "65ee788b-1995-470a-8bd3-2409d32094e5"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:00.051465 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-66e8e6f8-d4b4-4f57-913b-78a68eff6dee req-ce56ac5d-f4f1-4a63-aff1-7da0ac72372a service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:00.052235 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-66e8e6f8-d4b4-4f57-913b-78a68eff6dee req-ce56ac5d-f4f1-4a63-aff1-7da0ac72372a service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:00.067498 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-66e8e6f8-d4b4-4f57-913b-78a68eff6dee req-ce56ac5d-f4f1-4a63-aff1-7da0ac72372a service nova] Creating event network-changed:65ee788b-1995-470a-8bd3-2409d32094e5 for instance 43ddda1b-801a-438b-a86c-df7d1340dfba on hv-cinder-85144 Aug 02 21:48:00.075049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-66e8e6f8-d4b4-4f57-913b-78a68eff6dee req-ce56ac5d-f4f1-4a63-aff1-7da0ac72372a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044179 Aug 02 21:48:00.075649 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 400/774] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:00.135083 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-74280005-c994-4c7e-bf4d-d7d20652d1ab tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'create', calling method: .version_select at 0x7ff558008b80>, body: {"keypair": {"name": "tempest-keypair-1086784269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMB7ygX8yJXAiS15Utc4btIq6ESaoPwJaMIKA29SC2bC5e0K/lISgGC/CkgkYH7OpX7RzhflMQe/8x19XGLpsYz2pUKOvIhSlUJaiOpZjwgJvG2BA7ltg6wMdAnmZIxoAA=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:00.151152 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-74280005-c994-4c7e-bf4d-d7d20652d1ab tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Getting quotas for project 6c98a5a02318476daf8318190d7e1a76. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:48:00.155313 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-74280005-c994-4c7e-bf4d-d7d20652d1ab tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Getting quotas for user 3d13a56d271447bb936cea12e693b22f and project 6c98a5a02318476daf8318190d7e1a76. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:48:00.178008 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-74280005-c994-4c7e-bf4d-d7d20652d1ab tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047348 Aug 02 21:48:00.178603 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 375/775] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:48:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:00.807749 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6aae8c5e-8a60-446c-8151-15fe6a59d585 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:00.808708 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6aae8c5e-8a60-446c-8151-15fe6a59d585 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:00.815042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6aae8c5e-8a60-446c-8151-15fe6a59d585 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:00.815497 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6aae8c5e-8a60-446c-8151-15fe6a59d585 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:00.816306 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6aae8c5e-8a60-446c-8151-15fe6a59d585 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:00.816763 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6aae8c5e-8a60-446c-8151-15fe6a59d585 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:00.972556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6aae8c5e-8a60-446c-8151-15fe6a59d585 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:00.980880 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6aae8c5e-8a60-446c-8151-15fe6a59d585 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.178670 Aug 02 21:48:00.981458 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 401/776] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:00 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:48:02.001307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3f84a999-547b-4366-bf1c-cac60500aeb8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:02.001996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3f84a999-547b-4366-bf1c-cac60500aeb8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:02.009519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3f84a999-547b-4366-bf1c-cac60500aeb8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:02.010175 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3f84a999-547b-4366-bf1c-cac60500aeb8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:02.011111 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3f84a999-547b-4366-bf1c-cac60500aeb8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:02.011712 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3f84a999-547b-4366-bf1c-cac60500aeb8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:02.043775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-226280135", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72820f4b-3c99-4043-9068-d2cbe0570412"}], "security_groups": [{"name": "tempest-securitygroup--909493505"}], "key_name": "tempest-keypair-1086784269", "user_data": "}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:02.164248 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] validate_networks() for [('72820f4b-3c99-4043-9068-d2cbe0570412', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:48:02.168303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3f84a999-547b-4366-bf1c-cac60500aeb8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:02.176714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3f84a999-547b-4366-bf1c-cac60500aeb8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.179347 Aug 02 21:48:02.177395 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 376/777] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:01 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:02.538190 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:48:02.538625 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:48:02.539105 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:48:02.539553 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:48:02.539977 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:48:02.549011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:02.549468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:02.550277 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:02.550720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:02.569180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Getting quotas for project 6c98a5a02318476daf8318190d7e1a76. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:48:02.573938 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Getting quotas for user 3d13a56d271447bb936cea12e693b22f and project 6c98a5a02318476daf8318190d7e1a76. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:48:02.587986 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:48:02.590624 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:48:02.638705 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a0e0e1c9-13b6-4bb8-bc76-4a2d7969dc65 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.600217 Aug 02 21:48:02.639445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 402/778] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:48:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 21:48:02.650511 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-47eed4f9-8378-4818-af0d-5dde7c232f3a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:02.651126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-47eed4f9-8378-4818-af0d-5dde7c232f3a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:02.705128 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-47eed4f9-8378-4818-af0d-5dde7c232f3a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:02.711974 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-47eed4f9-8378-4818-af0d-5dde7c232f3a tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1237 microversion: 2.1 time: 0.065511 Aug 02 21:48:02.716163 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 377/779] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:02 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:03.199017 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-de1fde63-47ca-430d-8abc-596a32ee6ef0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:03.199549 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-de1fde63-47ca-430d-8abc-596a32ee6ef0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:03.206297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-de1fde63-47ca-430d-8abc-596a32ee6ef0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:03.206758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-de1fde63-47ca-430d-8abc-596a32ee6ef0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:03.207534 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-de1fde63-47ca-430d-8abc-596a32ee6ef0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:03.207979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-de1fde63-47ca-430d-8abc-596a32ee6ef0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:03.345962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-de1fde63-47ca-430d-8abc-596a32ee6ef0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:03.354711 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-de1fde63-47ca-430d-8abc-596a32ee6ef0 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.160821 Aug 02 21:48:03.355406 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 403/780] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:03 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:03.732892 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b185beb7-072e-4438-b44e-aa73fab52d44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:03.733495 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b185beb7-072e-4438-b44e-aa73fab52d44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:03.739856 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b185beb7-072e-4438-b44e-aa73fab52d44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:03.740428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b185beb7-072e-4438-b44e-aa73fab52d44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:03.741115 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b185beb7-072e-4438-b44e-aa73fab52d44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:03.741557 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b185beb7-072e-4438-b44e-aa73fab52d44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:03.809539 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b185beb7-072e-4438-b44e-aa73fab52d44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:03.817574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b185beb7-072e-4438-b44e-aa73fab52d44 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1289 microversion: 2.1 time: 0.088383 Aug 02 21:48:03.818152 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 378/781] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:03 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:04.379832 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9222d73d-42de-4140-a980-d8d6d2e53cbe tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:04.381117 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9222d73d-42de-4140-a980-d8d6d2e53cbe tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:04.388652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9222d73d-42de-4140-a980-d8d6d2e53cbe tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:04.389116 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9222d73d-42de-4140-a980-d8d6d2e53cbe tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:04.390049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9222d73d-42de-4140-a980-d8d6d2e53cbe tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:04.390664 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9222d73d-42de-4140-a980-d8d6d2e53cbe tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:04.548409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9222d73d-42de-4140-a980-d8d6d2e53cbe tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:04.558023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9222d73d-42de-4140-a980-d8d6d2e53cbe tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.184599 Aug 02 21:48:04.568555 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 404/782] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:04 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:04.840451 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-818b66f4-ca25-4969-9db6-41866a61efee tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:04.841641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-818b66f4-ca25-4969-9db6-41866a61efee tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:04.850305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-818b66f4-ca25-4969-9db6-41866a61efee tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:04.851154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-818b66f4-ca25-4969-9db6-41866a61efee tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:04.852367 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-818b66f4-ca25-4969-9db6-41866a61efee tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:04.854292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-818b66f4-ca25-4969-9db6-41866a61efee tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:05.136556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-818b66f4-ca25-4969-9db6-41866a61efee tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:05.144683 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-818b66f4-ca25-4969-9db6-41866a61efee tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.310066 Aug 02 21:48:05.155244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 379/783] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:04 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:05.579874 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8ded9e3a-dace-481f-9bc3-df73b6e0199c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:05.580710 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8ded9e3a-dace-481f-9bc3-df73b6e0199c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:05.587859 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8ded9e3a-dace-481f-9bc3-df73b6e0199c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:05.588472 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8ded9e3a-dace-481f-9bc3-df73b6e0199c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:05.589350 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8ded9e3a-dace-481f-9bc3-df73b6e0199c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:05.589942 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8ded9e3a-dace-481f-9bc3-df73b6e0199c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:05.676620 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-12dcc8ea-c8f9-480e-a182-ca5a855cd296 req-ed8b1a4d-a099-44f2-a678-0c83077afac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49a1721-ee1f-4401-abbf-ce8fa780dbfe", "tag": "23f3af35-5b76-4520-a7da-3babbb77df62"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:05.688766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-12dcc8ea-c8f9-480e-a182-ca5a855cd296 req-ed8b1a4d-a099-44f2-a678-0c83077afac4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:05.689501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-12dcc8ea-c8f9-480e-a182-ca5a855cd296 req-ed8b1a4d-a099-44f2-a678-0c83077afac4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:05.715326 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-12dcc8ea-c8f9-480e-a182-ca5a855cd296 req-ed8b1a4d-a099-44f2-a678-0c83077afac4 service nova] Creating event network-changed:23f3af35-5b76-4520-a7da-3babbb77df62 for instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe on hv-cinder-85144 Aug 02 21:48:05.724676 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-12dcc8ea-c8f9-480e-a182-ca5a855cd296 req-ed8b1a4d-a099-44f2-a678-0c83077afac4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059033 Aug 02 21:48:05.725961 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 380/784] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:48:05.735753 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8ded9e3a-dace-481f-9bc3-df73b6e0199c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:05.744042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8ded9e3a-dace-481f-9bc3-df73b6e0199c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.168725 Aug 02 21:48:05.744807 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 405/785] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:05 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:06.066783 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-51a7c922-04b1-4ad8-a59e-54ef3dc96895 req-1385aca2-5652-496c-ae9d-6a3b32c99ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7248b87b-aba6-40d9-b464-f824c44b1672", "name": "network-vif-plugged", "status": "completed", "tag": "5a4b7f07-13e7-408e-b7d9-3162f37424ed"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:06.080785 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-51a7c922-04b1-4ad8-a59e-54ef3dc96895 req-1385aca2-5652-496c-ae9d-6a3b32c99ec4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:06.081145 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-51a7c922-04b1-4ad8-a59e-54ef3dc96895 req-1385aca2-5652-496c-ae9d-6a3b32c99ec4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:06.094074 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-51a7c922-04b1-4ad8-a59e-54ef3dc96895 req-1385aca2-5652-496c-ae9d-6a3b32c99ec4 service nova] Creating event network-vif-plugged:5a4b7f07-13e7-408e-b7d9-3162f37424ed for instance 7248b87b-aba6-40d9-b464-f824c44b1672 on hv-cinder-85144 Aug 02 21:48:06.099476 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-51a7c922-04b1-4ad8-a59e-54ef3dc96895 req-1385aca2-5652-496c-ae9d-6a3b32c99ec4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041295 Aug 02 21:48:06.100651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 381/786] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:06.166653 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2a380341-5340-4104-9b28-398412e0c76f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:06.167408 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2a380341-5340-4104-9b28-398412e0c76f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:06.174011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2a380341-5340-4104-9b28-398412e0c76f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:06.174470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2a380341-5340-4104-9b28-398412e0c76f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:06.175287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2a380341-5340-4104-9b28-398412e0c76f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:06.175757 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2a380341-5340-4104-9b28-398412e0c76f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:06.316457 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2a380341-5340-4104-9b28-398412e0c76f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:06.326870 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2a380341-5340-4104-9b28-398412e0c76f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.164038 Aug 02 21:48:06.327886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 406/787] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:06 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:06.766439 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4c81742f-8f99-442c-87e2-186c0fe379c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:06.767068 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4c81742f-8f99-442c-87e2-186c0fe379c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:06.773566 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4c81742f-8f99-442c-87e2-186c0fe379c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:06.774022 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4c81742f-8f99-442c-87e2-186c0fe379c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:06.774793 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4c81742f-8f99-442c-87e2-186c0fe379c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:06.775238 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4c81742f-8f99-442c-87e2-186c0fe379c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:06.912049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4c81742f-8f99-442c-87e2-186c0fe379c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:06.923636 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4c81742f-8f99-442c-87e2-186c0fe379c9 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.161497 Aug 02 21:48:06.926505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 382/788] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:06 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:07.348291 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0725d04c-edf1-4656-85fb-2721e0c6a18c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:07.348902 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0725d04c-edf1-4656-85fb-2721e0c6a18c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:07.355421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0725d04c-edf1-4656-85fb-2721e0c6a18c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:07.355868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0725d04c-edf1-4656-85fb-2721e0c6a18c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:07.356659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0725d04c-edf1-4656-85fb-2721e0c6a18c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:07.357095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0725d04c-edf1-4656-85fb-2721e0c6a18c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:07.489430 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0725d04c-edf1-4656-85fb-2721e0c6a18c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:07.496879 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0725d04c-edf1-4656-85fb-2721e0c6a18c tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.152478 Aug 02 21:48:07.497445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 407/789] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:07 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:07.950160 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2f8e473a-c522-42b5-abd3-26ec34e80e91 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:07.950909 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2f8e473a-c522-42b5-abd3-26ec34e80e91 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:07.957743 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2f8e473a-c522-42b5-abd3-26ec34e80e91 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:07.958197 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2f8e473a-c522-42b5-abd3-26ec34e80e91 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:07.958976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2f8e473a-c522-42b5-abd3-26ec34e80e91 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:07.959416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2f8e473a-c522-42b5-abd3-26ec34e80e91 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:08.091659 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2f8e473a-c522-42b5-abd3-26ec34e80e91 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:08.099990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2f8e473a-c522-42b5-abd3-26ec34e80e91 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.153824 Aug 02 21:48:08.100671 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 383/790] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:07 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:08.518192 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1da96946-3e41-401d-94d0-4b96c7d7b606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:08.518728 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-1da96946-3e41-401d-94d0-4b96c7d7b606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:08.525747 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1da96946-3e41-401d-94d0-4b96c7d7b606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:08.526208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1da96946-3e41-401d-94d0-4b96c7d7b606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:08.526986 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1da96946-3e41-401d-94d0-4b96c7d7b606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:08.527434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1da96946-3e41-401d-94d0-4b96c7d7b606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:08.656683 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-1da96946-3e41-401d-94d0-4b96c7d7b606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:08.664835 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1da96946-3e41-401d-94d0-4b96c7d7b606 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.150829 Aug 02 21:48:08.665367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 408/791] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:08 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:09.122220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b6fbd2de-62c6-46ff-9c56-fddf109320ca tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:09.122771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b6fbd2de-62c6-46ff-9c56-fddf109320ca tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:09.129337 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b6fbd2de-62c6-46ff-9c56-fddf109320ca tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:09.129791 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b6fbd2de-62c6-46ff-9c56-fddf109320ca tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:09.130561 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b6fbd2de-62c6-46ff-9c56-fddf109320ca tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:09.131002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b6fbd2de-62c6-46ff-9c56-fddf109320ca tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:09.267664 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b6fbd2de-62c6-46ff-9c56-fddf109320ca tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:09.276409 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b6fbd2de-62c6-46ff-9c56-fddf109320ca tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.158103 Aug 02 21:48:09.276989 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 384/792] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:09 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:09.685541 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3ff1e177-1b65-4128-8cde-32dcd2cec677 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:09.686157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3ff1e177-1b65-4128-8cde-32dcd2cec677 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:09.692592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3ff1e177-1b65-4128-8cde-32dcd2cec677 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:09.693027 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3ff1e177-1b65-4128-8cde-32dcd2cec677 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:09.693791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3ff1e177-1b65-4128-8cde-32dcd2cec677 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:09.694225 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3ff1e177-1b65-4128-8cde-32dcd2cec677 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:09.825758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3ff1e177-1b65-4128-8cde-32dcd2cec677 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:09.833082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3ff1e177-1b65-4128-8cde-32dcd2cec677 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.151910 Aug 02 21:48:09.833646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 409/793] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:09 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:10.297198 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8b6e7e5e-4c59-4f80-a38a-4c6f4ab2c45e tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:10.297805 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8b6e7e5e-4c59-4f80-a38a-4c6f4ab2c45e tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:10.303971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8b6e7e5e-4c59-4f80-a38a-4c6f4ab2c45e tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:10.305058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8b6e7e5e-4c59-4f80-a38a-4c6f4ab2c45e tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:10.305812 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8b6e7e5e-4c59-4f80-a38a-4c6f4ab2c45e tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:10.306245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8b6e7e5e-4c59-4f80-a38a-4c6f4ab2c45e tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:10.438395 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8b6e7e5e-4c59-4f80-a38a-4c6f4ab2c45e tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:10.446033 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8b6e7e5e-4c59-4f80-a38a-4c6f4ab2c45e tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.152703 Aug 02 21:48:10.446601 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 385/794] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:10 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:10.854466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-033c1205-81eb-43c4-8281-2c6486939f34 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:10.855094 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-033c1205-81eb-43c4-8281-2c6486939f34 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:10.861599 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-033c1205-81eb-43c4-8281-2c6486939f34 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:10.862059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-033c1205-81eb-43c4-8281-2c6486939f34 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:10.862834 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-033c1205-81eb-43c4-8281-2c6486939f34 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:10.863277 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-033c1205-81eb-43c4-8281-2c6486939f34 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:10.994030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-033c1205-81eb-43c4-8281-2c6486939f34 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:11.003667 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-033c1205-81eb-43c4-8281-2c6486939f34 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.153641 Aug 02 21:48:11.004258 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 410/795] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:10 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:11.467478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-132980a1-18d5-41e8-bd9d-361b8ae25fa1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:11.468091 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-132980a1-18d5-41e8-bd9d-361b8ae25fa1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:11.474581 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-132980a1-18d5-41e8-bd9d-361b8ae25fa1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:11.475032 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-132980a1-18d5-41e8-bd9d-361b8ae25fa1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:11.475797 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-132980a1-18d5-41e8-bd9d-361b8ae25fa1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:11.476858 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-132980a1-18d5-41e8-bd9d-361b8ae25fa1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:11.605636 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-132980a1-18d5-41e8-bd9d-361b8ae25fa1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:11.613156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-132980a1-18d5-41e8-bd9d-361b8ae25fa1 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.149700 Aug 02 21:48:11.613721 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 386/796] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:11 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:12.024643 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-de77a4ca-205b-4c5d-85c3-1ebbddc1fce6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:12.025202 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-de77a4ca-205b-4c5d-85c3-1ebbddc1fce6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:12.031645 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-de77a4ca-205b-4c5d-85c3-1ebbddc1fce6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:12.032103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-de77a4ca-205b-4c5d-85c3-1ebbddc1fce6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:12.032901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-de77a4ca-205b-4c5d-85c3-1ebbddc1fce6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:12.033342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-de77a4ca-205b-4c5d-85c3-1ebbddc1fce6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:12.158968 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-de77a4ca-205b-4c5d-85c3-1ebbddc1fce6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:12.166340 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-de77a4ca-205b-4c5d-85c3-1ebbddc1fce6 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.146327 Aug 02 21:48:12.166909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 411/797] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:12 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:12.635568 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-90a3b449-1152-48ae-a2f2-85e016b6027a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:12.636247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-90a3b449-1152-48ae-a2f2-85e016b6027a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:12.643396 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-90a3b449-1152-48ae-a2f2-85e016b6027a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:12.643850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-90a3b449-1152-48ae-a2f2-85e016b6027a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:12.644653 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-90a3b449-1152-48ae-a2f2-85e016b6027a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:12.645585 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-90a3b449-1152-48ae-a2f2-85e016b6027a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:12.710088 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=6 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:12.779461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-90a3b449-1152-48ae-a2f2-85e016b6027a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:12.787259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-90a3b449-1152-48ae-a2f2-85e016b6027a tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.155643 Aug 02 21:48:12.787822 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 387/798] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:12 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:13.187471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-999e3ddb-e33b-4e3e-8c76-4fa1b1e4d093 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:13.188471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-999e3ddb-e33b-4e3e-8c76-4fa1b1e4d093 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:13.195201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:13.196444 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:13.199554 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-999e3ddb-e33b-4e3e-8c76-4fa1b1e4d093 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:13.200475 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-999e3ddb-e33b-4e3e-8c76-4fa1b1e4d093 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:13.201870 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-999e3ddb-e33b-4e3e-8c76-4fa1b1e4d093 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:13.202621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-999e3ddb-e33b-4e3e-8c76-4fa1b1e4d093 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:13.209702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:13.374764 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-999e3ddb-e33b-4e3e-8c76-4fa1b1e4d093 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:13.382323 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-999e3ddb-e33b-4e3e-8c76-4fa1b1e4d093 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.199216 Aug 02 21:48:13.382894 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 412/799] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:13 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:13.811671 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-85882397-57ad-48ff-96ea-1038fb7d0dc6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:13.812438 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-85882397-57ad-48ff-96ea-1038fb7d0dc6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:13.819015 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85882397-57ad-48ff-96ea-1038fb7d0dc6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:13.819548 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85882397-57ad-48ff-96ea-1038fb7d0dc6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:13.820407 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85882397-57ad-48ff-96ea-1038fb7d0dc6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:13.820933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85882397-57ad-48ff-96ea-1038fb7d0dc6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:14.019736 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-85882397-57ad-48ff-96ea-1038fb7d0dc6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:14.027801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-85882397-57ad-48ff-96ea-1038fb7d0dc6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1572 microversion: 2.1 time: 0.220049 Aug 02 21:48:14.028401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 388/800] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:13 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1572 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:14.403598 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-af7522f9-a6ff-4015-9efe-06221d97235b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:14.404198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-af7522f9-a6ff-4015-9efe-06221d97235b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:14.411233 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-af7522f9-a6ff-4015-9efe-06221d97235b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:14.411682 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-af7522f9-a6ff-4015-9efe-06221d97235b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:14.412483 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-af7522f9-a6ff-4015-9efe-06221d97235b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:14.412924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-af7522f9-a6ff-4015-9efe-06221d97235b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:14.575785 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-af7522f9-a6ff-4015-9efe-06221d97235b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:14.583955 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-af7522f9-a6ff-4015-9efe-06221d97235b tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.184177 Aug 02 21:48:14.586241 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 413/801] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:14 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:14.636113 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-425507cf-129f-4b75-a225-4240cf2e1b54 req-8131c3ff-545d-414b-8fb7-243d881ef9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49a1721-ee1f-4401-abbf-ce8fa780dbfe", "name": "network-vif-plugged", "status": "completed", "tag": "23f3af35-5b76-4520-a7da-3babbb77df62"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:14.652699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-425507cf-129f-4b75-a225-4240cf2e1b54 req-8131c3ff-545d-414b-8fb7-243d881ef9d1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:14.653368 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-425507cf-129f-4b75-a225-4240cf2e1b54 req-8131c3ff-545d-414b-8fb7-243d881ef9d1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:14.665402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-425507cf-129f-4b75-a225-4240cf2e1b54 req-8131c3ff-545d-414b-8fb7-243d881ef9d1 service nova] Creating event network-vif-plugged:23f3af35-5b76-4520-a7da-3babbb77df62 for instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe on hv-cinder-85144 Aug 02 21:48:14.670215 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-425507cf-129f-4b75-a225-4240cf2e1b54 req-8131c3ff-545d-414b-8fb7-243d881ef9d1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038915 Aug 02 21:48:14.671135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 389/802] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:15.048207 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6c810349-bda9-4cd3-bb2c-31f8b49cbe8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:15.048928 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6c810349-bda9-4cd3-bb2c-31f8b49cbe8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:15.055446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6c810349-bda9-4cd3-bb2c-31f8b49cbe8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:15.055970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6c810349-bda9-4cd3-bb2c-31f8b49cbe8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:15.056839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6c810349-bda9-4cd3-bb2c-31f8b49cbe8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:15.057277 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6c810349-bda9-4cd3-bb2c-31f8b49cbe8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:15.187311 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6c810349-bda9-4cd3-bb2c-31f8b49cbe8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:15.195643 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6c810349-bda9-4cd3-bb2c-31f8b49cbe8b tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1559 microversion: 2.1 time: 0.151501 Aug 02 21:48:15.196230 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 414/803] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:15 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:15.608856 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7ed5869e-6172-45d0-bbe0-96a4d1df0ace tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:15.610226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7ed5869e-6172-45d0-bbe0-96a4d1df0ace tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:15.617297 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7ed5869e-6172-45d0-bbe0-96a4d1df0ace tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:15.617849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7ed5869e-6172-45d0-bbe0-96a4d1df0ace tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:15.618765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7ed5869e-6172-45d0-bbe0-96a4d1df0ace tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:15.619941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7ed5869e-6172-45d0-bbe0-96a4d1df0ace tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:15.807270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7ed5869e-6172-45d0-bbe0-96a4d1df0ace tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:15.815285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7ed5869e-6172-45d0-bbe0-96a4d1df0ace tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.211504 Aug 02 21:48:15.815854 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 390/804] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:15 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:16.836753 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-df016cc5-79a7-443e-ba08-c9179d240e26 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:16.837369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-df016cc5-79a7-443e-ba08-c9179d240e26 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:16.843831 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-df016cc5-79a7-443e-ba08-c9179d240e26 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:16.844319 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-df016cc5-79a7-443e-ba08-c9179d240e26 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:16.845097 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-df016cc5-79a7-443e-ba08-c9179d240e26 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:16.845537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-df016cc5-79a7-443e-ba08-c9179d240e26 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:16.986757 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-df016cc5-79a7-443e-ba08-c9179d240e26 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:16.995122 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-df016cc5-79a7-443e-ba08-c9179d240e26 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1362 microversion: 2.1 time: 0.162212 Aug 02 21:48:16.995692 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 415/805] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:16 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:18.015096 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4d5f6868-63b6-44ab-ab35-bda02193e5dd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:18.015717 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4d5f6868-63b6-44ab-ab35-bda02193e5dd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:18.022570 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4d5f6868-63b6-44ab-ab35-bda02193e5dd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:18.023079 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4d5f6868-63b6-44ab-ab35-bda02193e5dd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:18.023857 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4d5f6868-63b6-44ab-ab35-bda02193e5dd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:18.024331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4d5f6868-63b6-44ab-ab35-bda02193e5dd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:18.150481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4d5f6868-63b6-44ab-ab35-bda02193e5dd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:18.158026 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4d5f6868-63b6-44ab-ab35-bda02193e5dd tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1548 microversion: 2.1 time: 0.146842 Aug 02 21:48:18.158601 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 391/806] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:18 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:18.178501 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d1c94df5-b92b-4031-be53-16fa11aa740e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:18.179024 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d1c94df5-b92b-4031-be53-16fa11aa740e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:18.185535 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d1c94df5-b92b-4031-be53-16fa11aa740e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:18.185985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d1c94df5-b92b-4031-be53-16fa11aa740e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:18.186753 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d1c94df5-b92b-4031-be53-16fa11aa740e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:18.187188 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d1c94df5-b92b-4031-be53-16fa11aa740e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:18.265413 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d1c94df5-b92b-4031-be53-16fa11aa740e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090699 Aug 02 21:48:18.266076 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 416/807] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 2 21:48:18 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:19.207529 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-28deb8aa-cb88-4212-84e9-e424a6faf204 req-1a82e2ef-39ce-4bcb-a464-0573c7742d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49a1721-ee1f-4401-abbf-ce8fa780dbfe", "tag": "23f3af35-5b76-4520-a7da-3babbb77df62"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:19.217413 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-28deb8aa-cb88-4212-84e9-e424a6faf204 req-1a82e2ef-39ce-4bcb-a464-0573c7742d0c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:19.218017 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-28deb8aa-cb88-4212-84e9-e424a6faf204 req-1a82e2ef-39ce-4bcb-a464-0573c7742d0c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:19.230024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-28deb8aa-cb88-4212-84e9-e424a6faf204 req-1a82e2ef-39ce-4bcb-a464-0573c7742d0c service nova] Creating event network-changed:23f3af35-5b76-4520-a7da-3babbb77df62 for instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe on hv-cinder-85144 Aug 02 21:48:19.235732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-28deb8aa-cb88-4212-84e9-e424a6faf204 req-1a82e2ef-39ce-4bcb-a464-0573c7742d0c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031291 Aug 02 21:48:19.236085 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 392/808] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:20.226332 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ac0110a0-35c1-48d9-9b90-3660f152e90b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:20.226970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ac0110a0-35c1-48d9-9b90-3660f152e90b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:20.232917 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ac0110a0-35c1-48d9-9b90-3660f152e90b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:20.233378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ac0110a0-35c1-48d9-9b90-3660f152e90b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:20.234158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ac0110a0-35c1-48d9-9b90-3660f152e90b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:20.234607 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ac0110a0-35c1-48d9-9b90-3660f152e90b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:20.258282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ac0110a0-35c1-48d9-9b90-3660f152e90b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/ips" status: 200 len: 150 microversion: 2.1 time: 0.036416 Aug 02 21:48:20.258913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 417/809] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:48:20 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:48:21.580155 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7d0f2268-8b73-49f9-bd4b-35f3f8974940 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1bee34f-5595-4084-a03e-87c995285ec9"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:21.582617 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7d0f2268-8b73-49f9-bd4b-35f3f8974940 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:21.589864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7d0f2268-8b73-49f9-bd4b-35f3f8974940 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:21.590315 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7d0f2268-8b73-49f9-bd4b-35f3f8974940 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:21.591103 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7d0f2268-8b73-49f9-bd4b-35f3f8974940 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:21.591632 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7d0f2268-8b73-49f9-bd4b-35f3f8974940 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:21.836481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:21.846918 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7d0f2268-8b73-49f9-bd4b-35f3f8974940 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271002 Aug 02 21:48:21.849768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 393/810] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:48:21 2022] POST /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:29.365876 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1bee34f-5595-4084-a03e-87c995285ec9"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:29.368589 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:29.371175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:29.376539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:29.376990 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:29.377760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:29.378196 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:29.458541 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Invalid volume: volume d1bee34f-5595-4084-a03e-87c995285ec9 is already attached to instances: 935f0f24-4d12-498c-bb68-770aa9ee2210 Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: POST /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments HTTP/1.1 Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 74 Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:48:29.460280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {"volumeAttachment": {"volumeId": "d1bee34f-5595-4084-a03e-87c995285ec9"}} Aug 02 21:48:29.461885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Invalid volume: volume d1bee34f-5595-4084-a03e-87c995285ec9 is already attached to instances: 935f0f24-4d12-498c-bb68-770aa9ee2210 Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'server_id': '935f0f24-4d12-498c-bb68-770aa9ee2210', 'body': {'volumeAttachment': {'volumeId': 'd1bee34f-5595-4084-a03e-87c995285ec9'}}} Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d1bee34f-5595-4084-a03e-87c995285ec9 is already attached to instances: 935f0f24-4d12-498c-bb68-770aa9ee2210 Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:48:29.462745 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d1bee34f-5595-4084-a03e-87c995285ec9 is already attached to instances: 935f0f24-4d12-498c-bb68-770aa9ee2210 Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:48:29.464668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:48:29.465925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:48:29.465925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:48:29.465925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:48:29.465925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d1bee34f-5595-4084-a03e-87c995285ec9 is already attached to instances: 935f0f24-4d12-498c-bb68-770aa9ee2210 Aug 02 21:48:29.465925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:48:29.465925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 400 to user: Invalid volume: volume d1bee34f-5595-4084-a03e-87c995285ec9 is already attached to instances: 935f0f24-4d12-498c-bb68-770aa9ee2210 {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:48:29.465925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-44e9f415-8faf-441a-9746-d94c24bf44b1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100389 Aug 02 21:48:29.465925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 418/811] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:48:29 2022] POST /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 21:48:29.526557 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d8d769cb-b8f2-43f9-b8ee-4b78a9efced1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:29.527134 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d8d769cb-b8f2-43f9-b8ee-4b78a9efced1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:29.529982 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:29.535766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8d769cb-b8f2-43f9-b8ee-4b78a9efced1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:29.536247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8d769cb-b8f2-43f9-b8ee-4b78a9efced1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:29.537019 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8d769cb-b8f2-43f9-b8ee-4b78a9efced1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:29.537463 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8d769cb-b8f2-43f9-b8ee-4b78a9efced1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:29.619022 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-d8d769cb-b8f2-43f9-b8ee-4b78a9efced1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lazy-loading 'services' on Instance uuid 935f0f24-4d12-498c-bb68-770aa9ee2210 {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:48:29.691299 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d8d769cb-b8f2-43f9-b8ee-4b78a9efced1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments/d1bee34f-5595-4084-a03e-87c995285ec9" status: 202 len: 0 microversion: 2.1 time: 0.168855 Aug 02 21:48:29.691879 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 394/812] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:48:29 2022] DELETE /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments/d1bee34f-5595-4084-a03e-87c995285ec9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:48:29.701041 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-60841f9a-62fb-4673-bf69-3d41c8c58a39 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:29.703169 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-60841f9a-62fb-4673-bf69-3d41c8c58a39 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:29.713817 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60841f9a-62fb-4673-bf69-3d41c8c58a39 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:29.715315 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60841f9a-62fb-4673-bf69-3d41c8c58a39 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:29.716693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60841f9a-62fb-4673-bf69-3d41c8c58a39 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:29.717460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60841f9a-62fb-4673-bf69-3d41c8c58a39 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:29.747372 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-60841f9a-62fb-4673-bf69-3d41c8c58a39 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050951 Aug 02 21:48:29.747943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 419/813] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:48:29 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:30.761449 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8d2e5194-fa7d-439d-adfa-1bc0d2b4fd24 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:30.763759 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8d2e5194-fa7d-439d-adfa-1bc0d2b4fd24 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:30.770584 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8d2e5194-fa7d-439d-adfa-1bc0d2b4fd24 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:30.771217 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8d2e5194-fa7d-439d-adfa-1bc0d2b4fd24 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:30.771976 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8d2e5194-fa7d-439d-adfa-1bc0d2b4fd24 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:30.772543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8d2e5194-fa7d-439d-adfa-1bc0d2b4fd24 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:30.801881 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8d2e5194-fa7d-439d-adfa-1bc0d2b4fd24 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045253 Aug 02 21:48:30.801881 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 395/814] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:48:30 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:48:30.863603 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-be0e92f3-6dea-4f86-8aee-f25a270af469 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:30.864102 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-be0e92f3-6dea-4f86-8aee-f25a270af469 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:30.870526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be0e92f3-6dea-4f86-8aee-f25a270af469 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:30.870971 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be0e92f3-6dea-4f86-8aee-f25a270af469 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:30.871730 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be0e92f3-6dea-4f86-8aee-f25a270af469 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:30.872191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-be0e92f3-6dea-4f86-8aee-f25a270af469 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:30.896294 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-be0e92f3-6dea-4f86-8aee-f25a270af469 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:48:30.968284 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-be0e92f3-6dea-4f86-8aee-f25a270af469 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 204 len: 0 microversion: 2.1 time: 0.108186 Aug 02 21:48:30.968784 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 420/815] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:48:30 2022] DELETE /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:48:30.977191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f091700a-b3ce-4513-bef6-533c149a8634 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:30.977802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f091700a-b3ce-4513-bef6-533c149a8634 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:30.984426 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f091700a-b3ce-4513-bef6-533c149a8634 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:30.984873 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f091700a-b3ce-4513-bef6-533c149a8634 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:30.985631 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f091700a-b3ce-4513-bef6-533c149a8634 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:30.986067 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f091700a-b3ce-4513-bef6-533c149a8634 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:31.345505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f091700a-b3ce-4513-bef6-533c149a8634 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:31.352929 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f091700a-b3ce-4513-bef6-533c149a8634 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1680 microversion: 2.1 time: 0.379590 Aug 02 21:48:31.353485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 396/816] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:30 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1680 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:48:32.374869 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-da41f747-dfb6-4cc9-91ce-d88831b5e081 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:32.375582 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-da41f747-dfb6-4cc9-91ce-d88831b5e081 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:32.386480 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-da41f747-dfb6-4cc9-91ce-d88831b5e081 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:32.387266 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-da41f747-dfb6-4cc9-91ce-d88831b5e081 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:32.388568 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-da41f747-dfb6-4cc9-91ce-d88831b5e081 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:32.389028 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-da41f747-dfb6-4cc9-91ce-d88831b5e081 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:32.522207 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-da41f747-dfb6-4cc9-91ce-d88831b5e081 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:32.530089 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-da41f747-dfb6-4cc9-91ce-d88831b5e081 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1680 microversion: 2.1 time: 0.159955 Aug 02 21:48:32.530654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 421/817] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:32 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:33.552169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-eea9221b-5745-4d8a-be42-1161ccc0236e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:33.553462 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-eea9221b-5745-4d8a-be42-1161ccc0236e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:33.562900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eea9221b-5745-4d8a-be42-1161ccc0236e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:33.563355 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eea9221b-5745-4d8a-be42-1161ccc0236e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:33.571911 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eea9221b-5745-4d8a-be42-1161ccc0236e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:33.572471 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eea9221b-5745-4d8a-be42-1161ccc0236e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:33.760953 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-eea9221b-5745-4d8a-be42-1161ccc0236e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:33.768735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-eea9221b-5745-4d8a-be42-1161ccc0236e tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 200 len: 1680 microversion: 2.1 time: 0.220545 Aug 02 21:48:33.769306 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 397/818] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:33 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:34.111978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-7fbc2081-402f-4776-bb8f-b2ce969b618a req-01e019b0-091a-4d6a-80c1-bdc8eb973760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935f0f24-4d12-498c-bb68-770aa9ee2210", "name": "network-vif-deleted", "tag": "f59aa865-1125-46ab-a52c-dea7421d5460"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:34.123673 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7fbc2081-402f-4776-bb8f-b2ce969b618a req-01e019b0-091a-4d6a-80c1-bdc8eb973760 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:34.124242 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7fbc2081-402f-4776-bb8f-b2ce969b618a req-01e019b0-091a-4d6a-80c1-bdc8eb973760 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:34.135857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-7fbc2081-402f-4776-bb8f-b2ce969b618a req-01e019b0-091a-4d6a-80c1-bdc8eb973760 service nova] Creating event network-vif-deleted:f59aa865-1125-46ab-a52c-dea7421d5460 for instance 935f0f24-4d12-498c-bb68-770aa9ee2210 on hv-cinder-85144 Aug 02 21:48:34.141184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-7fbc2081-402f-4776-bb8f-b2ce969b618a req-01e019b0-091a-4d6a-80c1-bdc8eb973760 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034409 Aug 02 21:48:34.142418 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 422/819] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:34.790721 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:34.791345 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:34.798067 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:34.798685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:34.799514 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:34.799957 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:34.819358 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 HTTP/1.1 Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:48:34.821095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:48:34.822545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '935f0f24-4d12-498c-bb68-770aa9ee2210'} Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:48:34.823983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:48:34.825402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:48:34.826455 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:48:34.826455 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3c700c6b-b1cb-4d3a-bbae-3bf7d34ce2f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 404 len: 111 microversion: 2.1 time: 0.035848 Aug 02 21:48:34.826455 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 398/820] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:34 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:48:34.832540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b6730f61-a25b-4070-9aad-ca55876a6834 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '.version_select at 0x7ff552e40160>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:34.853061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b6730f61-a25b-4070-9aad-ca55876a6834 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433383095" status: 202 len: 0 microversion: 2.1 time: 0.024520 Aug 02 21:48:34.853944 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 423/821] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 2 21:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433383095 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 21:48:35.476392 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-97103a86-b940-4975-a430-556eb1c9a629 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: .version_select at 0x7ff552e27e50>, body: {"keypair": {"name": "tempest-keypair-1772885549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJl5lTlwyR8jf2UVASLctylzCOQz/B9Kc40qoKdyLCdWiG19UhZXdqMfxZ6HMszFZEqJvDsY06ybHj4JFMIiBGV2CP3uc0NhMrP/yJaOkHdwJCoVeqe16kwnVOxb2Ejarg=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:35.491444 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-97103a86-b940-4975-a430-556eb1c9a629 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for project c63bab062a6e4225a462ac0265535d16. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:48:35.495764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-97103a86-b940-4975-a430-556eb1c9a629 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for user e477f5953a534355b29c071086846ff6 and project c63bab062a6e4225a462ac0265535d16. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:48:35.517746 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-97103a86-b940-4975-a430-556eb1c9a629 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045317 Aug 02 21:48:35.518326 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 399/822] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:48:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:36.677425 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7586c96e-607d-431a-8247-f6a4d22619bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:36.678559 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7586c96e-607d-431a-8247-f6a4d22619bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:36.685296 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7586c96e-607d-431a-8247-f6a4d22619bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:36.685749 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7586c96e-607d-431a-8247-f6a4d22619bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:36.686519 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7586c96e-607d-431a-8247-f6a4d22619bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:36.686955 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7586c96e-607d-431a-8247-f6a4d22619bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:36.710544 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7586c96e-607d-431a-8247-f6a4d22619bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/ips" status: 200 len: 151 microversion: 2.20 time: 0.037611 Aug 02 21:48:36.711106 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 424/823] 10.222.0.57 () {60 vars in 1289 bytes} [Tue Aug 2 21:48:36 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:48:36.755229 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-512919969", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d6d25b-0453-4cac-840b-702ab041b963"}], "security_groups": [{"name": "tempest-securitygroup--2002382410"}], "key_name": "tempest-keypair-1772885549", "user_data": "}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:36.868595 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] validate_networks() for [('93d6d25b-0453-4cac-840b-702ab041b963', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:48:37.254388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:48:37.254850 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:48:37.255353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:48:37.255799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:48:37.256247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:48:37.265582 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:37.266064 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:37.267125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:37.267565 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:37.285081 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for project c63bab062a6e4225a462ac0265535d16. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:48:37.289024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Getting quotas for user e477f5953a534355b29c071086846ff6 and project c63bab062a6e4225a462ac0265535d16. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:48:37.300070 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:48:37.302353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:48:37.349306 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c71b80ec-3a28-4ab2-a8a3-ca742ff4cb82 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598762 Aug 02 21:48:37.349968 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 400/824] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:48:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:48:37.360702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ae5efe3e-b904-41d5-a2aa-ff5aaee766ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:37.361327 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ae5efe3e-b904-41d5-a2aa-ff5aaee766ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:37.421901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ae5efe3e-b904-41d5-a2aa-ff5aaee766ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:37.429171 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ae5efe3e-b904-41d5-a2aa-ff5aaee766ff tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1241 microversion: 2.1 time: 0.072227 Aug 02 21:48:37.429763 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 425/825] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:37 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:38.450427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-192dae5d-9657-451d-bfde-8bae29e2ff10 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:38.451748 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-192dae5d-9657-451d-bfde-8bae29e2ff10 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:38.458314 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-192dae5d-9657-451d-bfde-8bae29e2ff10 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:38.458819 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-192dae5d-9657-451d-bfde-8bae29e2ff10 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:38.459988 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-192dae5d-9657-451d-bfde-8bae29e2ff10 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:38.460441 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-192dae5d-9657-451d-bfde-8bae29e2ff10 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:38.689246 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-192dae5d-9657-451d-bfde-8bae29e2ff10 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:38.696611 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-192dae5d-9657-451d-bfde-8bae29e2ff10 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1311 microversion: 2.1 time: 0.250824 Aug 02 21:48:38.697169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 401/826] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:38 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:38.912110 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-493d38f3-c9f4-4ead-bede-8592bff7f1dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:38.912774 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-493d38f3-c9f4-4ead-bede-8592bff7f1dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:38.919879 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-493d38f3-c9f4-4ead-bede-8592bff7f1dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:38.920491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-493d38f3-c9f4-4ead-bede-8592bff7f1dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:38.921343 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-493d38f3-c9f4-4ead-bede-8592bff7f1dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:38.921788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-493d38f3-c9f4-4ead-bede-8592bff7f1dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:38.946462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-493d38f3-c9f4-4ead-bede-8592bff7f1dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lazy-loading 'flavor' on Instance uuid 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:48:39.127280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-493d38f3-c9f4-4ead-bede-8592bff7f1dd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/action" status: 202 len: 0 microversion: 2.20 time: 0.218919 Aug 02 21:48:39.127908 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 426/827] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 2 21:48:38 2022] POST /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:48:39.137959 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:39.138737 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:39.145423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:39.146158 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:39.147116 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:39.147662 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:39.376971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:39.385766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:39.387350 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:39.388590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bb4d6087-8ec8-4b40-9c37-ca1f9f451bf0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.256034 Aug 02 21:48:39.400647 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 402/828] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:39 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:39.719544 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fd3e0846-fbaa-4f5b-aaf9-d2b87ba9f138 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:39.720408 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-fd3e0846-fbaa-4f5b-aaf9-d2b87ba9f138 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:39.727107 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fd3e0846-fbaa-4f5b-aaf9-d2b87ba9f138 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:39.727648 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fd3e0846-fbaa-4f5b-aaf9-d2b87ba9f138 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:39.728690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fd3e0846-fbaa-4f5b-aaf9-d2b87ba9f138 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:39.729285 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fd3e0846-fbaa-4f5b-aaf9-d2b87ba9f138 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:39.862796 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-fd3e0846-fbaa-4f5b-aaf9-d2b87ba9f138 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:39.870839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-fd3e0846-fbaa-4f5b-aaf9-d2b87ba9f138 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1367 microversion: 2.1 time: 0.155667 Aug 02 21:48:39.871401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 427/829] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:39 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:39.962489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-a898e683-a296-4dab-be85-014981d53c5f req-54eaf68a-ef60-4a89-ad2f-0573ba7a483b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01042a8e-a479-4f1d-9239-6fb722bcd33d", "tag": "d1f41ccf-c167-413e-a0fd-a61749acbead"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:39.973626 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-a898e683-a296-4dab-be85-014981d53c5f req-54eaf68a-ef60-4a89-ad2f-0573ba7a483b service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:39.974230 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-a898e683-a296-4dab-be85-014981d53c5f req-54eaf68a-ef60-4a89-ad2f-0573ba7a483b service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:39.985845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-a898e683-a296-4dab-be85-014981d53c5f req-54eaf68a-ef60-4a89-ad2f-0573ba7a483b service nova] Creating event network-changed:d1f41ccf-c167-413e-a0fd-a61749acbead for instance 01042a8e-a479-4f1d-9239-6fb722bcd33d on hv-cinder-85144 Aug 02 21:48:39.990506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-a898e683-a296-4dab-be85-014981d53c5f req-54eaf68a-ef60-4a89-ad2f-0573ba7a483b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031894 Aug 02 21:48:39.991098 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 403/830] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:48:40.411811 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:40.412470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:40.419057 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:40.419612 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:40.420425 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:40.420877 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:40.555112 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:40.558457 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:40.567510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:40.569100 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:40.570289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-46b310ab-6488-4e30-83cc-be165ebabbd0 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.162401 Aug 02 21:48:40.570856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 428/831] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:40 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:40.891344 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-eed91429-97a2-4e52-bace-171d1e7bf0a8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:40.892320 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-eed91429-97a2-4e52-bace-171d1e7bf0a8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:40.898600 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eed91429-97a2-4e52-bace-171d1e7bf0a8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:40.899044 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eed91429-97a2-4e52-bace-171d1e7bf0a8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:40.899805 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eed91429-97a2-4e52-bace-171d1e7bf0a8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:40.900260 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-eed91429-97a2-4e52-bace-171d1e7bf0a8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:41.032560 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-eed91429-97a2-4e52-bace-171d1e7bf0a8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:41.039940 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-eed91429-97a2-4e52-bace-171d1e7bf0a8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1367 microversion: 2.1 time: 0.152865 Aug 02 21:48:41.040528 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 404/832] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:40 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:41.594022 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:41.594631 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:41.602089 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:41.602548 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:41.603321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:41.603765 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:41.730189 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:41.738065 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:41.739555 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:41.740732 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-594b3e09-ee67-41db-a2d5-cba557d14c76 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.150968 Aug 02 21:48:41.741292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 429/833] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:41 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:42.060641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e8936694-fd97-40c3-adc3-8485c76673c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:42.061263 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e8936694-fd97-40c3-adc3-8485c76673c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:42.067705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e8936694-fd97-40c3-adc3-8485c76673c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:42.068186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e8936694-fd97-40c3-adc3-8485c76673c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:42.068966 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e8936694-fd97-40c3-adc3-8485c76673c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:42.069407 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e8936694-fd97-40c3-adc3-8485c76673c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:42.192644 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e8936694-fd97-40c3-adc3-8485c76673c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:42.200160 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e8936694-fd97-40c3-adc3-8485c76673c6 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1367 microversion: 2.1 time: 0.143408 Aug 02 21:48:42.200797 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 405/834] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:42 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:42.763895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:42.764530 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:42.771212 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:42.771604 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:42.772389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:42.772827 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:42.903021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:42.910841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:42.912382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:42.913548 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2c81f39f-baae-44e4-ade0-70d4be20b324 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.153639 Aug 02 21:48:42.914109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 430/835] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:42 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:43.221002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7e097bff-00a0-4ba0-8714-7697c1f28ff1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:43.221753 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7e097bff-00a0-4ba0-8714-7697c1f28ff1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:43.228678 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e097bff-00a0-4ba0-8714-7697c1f28ff1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:43.229146 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e097bff-00a0-4ba0-8714-7697c1f28ff1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:43.230077 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e097bff-00a0-4ba0-8714-7697c1f28ff1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:43.230608 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e097bff-00a0-4ba0-8714-7697c1f28ff1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:43.446070 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7e097bff-00a0-4ba0-8714-7697c1f28ff1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:43.455410 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7e097bff-00a0-4ba0-8714-7697c1f28ff1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1367 microversion: 2.1 time: 0.238343 Aug 02 21:48:43.455983 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 406/836] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:43 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:43.936663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:43.937270 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:43.943679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:43.944127 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:43.944921 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:43.945353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:44.070724 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:44.078494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:44.079968 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:44.081150 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-494fd9c3-7536-4e15-8b73-819e0969c88b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.148979 Aug 02 21:48:44.081710 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 431/837] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:43 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:44.477111 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c4e579b4-7ad0-43ee-98f8-763706904981 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:44.477640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c4e579b4-7ad0-43ee-98f8-763706904981 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:44.485063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c4e579b4-7ad0-43ee-98f8-763706904981 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:44.485516 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c4e579b4-7ad0-43ee-98f8-763706904981 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:44.486283 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c4e579b4-7ad0-43ee-98f8-763706904981 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:44.486720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c4e579b4-7ad0-43ee-98f8-763706904981 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:44.701429 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-ba631edb-fd25-47c2-acff-dde9f5c4a3c7 req-db03fc76-f56c-40c5-8ed0-9f3ccff59420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01042a8e-a479-4f1d-9239-6fb722bcd33d", "name": "network-vif-plugged", "status": "completed", "tag": "d1f41ccf-c167-413e-a0fd-a61749acbead"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:44.711773 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-ba631edb-fd25-47c2-acff-dde9f5c4a3c7 req-db03fc76-f56c-40c5-8ed0-9f3ccff59420 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:44.712301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-ba631edb-fd25-47c2-acff-dde9f5c4a3c7 req-db03fc76-f56c-40c5-8ed0-9f3ccff59420 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:44.728165 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-ba631edb-fd25-47c2-acff-dde9f5c4a3c7 req-db03fc76-f56c-40c5-8ed0-9f3ccff59420 service nova] Creating event network-vif-plugged:d1f41ccf-c167-413e-a0fd-a61749acbead for instance 01042a8e-a479-4f1d-9239-6fb722bcd33d on hv-cinder-85144 Aug 02 21:48:44.733355 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-ba631edb-fd25-47c2-acff-dde9f5c4a3c7 req-db03fc76-f56c-40c5-8ed0-9f3ccff59420 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036128 Aug 02 21:48:44.734005 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 432/838] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:44.884224 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c4e579b4-7ad0-43ee-98f8-763706904981 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:44.892724 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c4e579b4-7ad0-43ee-98f8-763706904981 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1367 microversion: 2.1 time: 0.419713 Aug 02 21:48:44.893282 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 407/839] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:44 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:45.104799 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:45.105501 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:45.111690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:45.112158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:45.112950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:45.113390 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:45.255876 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:45.264423 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:45.265917 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:45.267367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3e6df209-4742-4a02-b57c-e2b8213e0686 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.167132 Aug 02 21:48:45.267919 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 433/840] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:45 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:45.913878 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b87e1857-27e8-4640-a705-3e140e085162 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:45.914623 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b87e1857-27e8-4640-a705-3e140e085162 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:45.921898 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b87e1857-27e8-4640-a705-3e140e085162 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:45.922355 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b87e1857-27e8-4640-a705-3e140e085162 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:45.923131 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b87e1857-27e8-4640-a705-3e140e085162 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:45.923578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b87e1857-27e8-4640-a705-3e140e085162 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:46.052007 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b87e1857-27e8-4640-a705-3e140e085162 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:46.059403 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b87e1857-27e8-4640-a705-3e140e085162 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1367 microversion: 2.1 time: 0.149437 Aug 02 21:48:46.059966 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 408/841] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:45 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:46.289725 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:46.290341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:46.296854 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:46.297312 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:46.298081 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:46.298523 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:46.427932 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:46.435909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:46.437459 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:46.438646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-66768734-ac3d-4eb4-afb6-7d5ec6e20730 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.152816 Aug 02 21:48:46.439200 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 434/842] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:46 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:47.079633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6581ef1f-a3b8-4550-833c-c71b3d8b985a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:47.080281 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6581ef1f-a3b8-4550-833c-c71b3d8b985a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:47.086683 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6581ef1f-a3b8-4550-833c-c71b3d8b985a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:47.087142 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6581ef1f-a3b8-4550-833c-c71b3d8b985a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:47.087914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6581ef1f-a3b8-4550-833c-c71b3d8b985a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:47.088393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6581ef1f-a3b8-4550-833c-c71b3d8b985a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:47.214388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6581ef1f-a3b8-4550-833c-c71b3d8b985a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:47.221953 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6581ef1f-a3b8-4550-833c-c71b3d8b985a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1558 microversion: 2.1 time: 0.146212 Aug 02 21:48:47.222531 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 409/843] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:48:47 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:48:47.243223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-441e3234-a819-41d4-a7b6-8e47eb2c0e2f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:47.243655 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-441e3234-a819-41d4-a7b6-8e47eb2c0e2f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:47.250356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-441e3234-a819-41d4-a7b6-8e47eb2c0e2f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:47.250812 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-441e3234-a819-41d4-a7b6-8e47eb2c0e2f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:47.251588 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-441e3234-a819-41d4-a7b6-8e47eb2c0e2f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:47.252030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-441e3234-a819-41d4-a7b6-8e47eb2c0e2f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:47.326483 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-441e3234-a819-41d4-a7b6-8e47eb2c0e2f tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087151 Aug 02 21:48:47.327061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 435/844] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 2 21:48:47 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:47.462416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:47.463145 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:47.466192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:47.467114 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=10 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:47.473673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:47.474139 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:47.474928 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:47.475369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:47.608558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:47.616624 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:47.618279 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:47.619435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-45a0b48b-cda1-42ae-a15a-d104d39ce77d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.161123 Aug 02 21:48:47.619993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 410/845] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:47 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:48.485961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:48.490337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-a8680328-4af3-449a-bf94-6681aa23bb38 req-54e41885-2c10-42b5-b4aa-6710f587a7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01042a8e-a479-4f1d-9239-6fb722bcd33d", "tag": "d1f41ccf-c167-413e-a0fd-a61749acbead"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:48.500529 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-a8680328-4af3-449a-bf94-6681aa23bb38 req-54e41885-2c10-42b5-b4aa-6710f587a7ea service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:48.500974 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-a8680328-4af3-449a-bf94-6681aa23bb38 req-54e41885-2c10-42b5-b4aa-6710f587a7ea service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:48.511785 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-a8680328-4af3-449a-bf94-6681aa23bb38 req-54e41885-2c10-42b5-b4aa-6710f587a7ea service nova] Creating event network-changed:d1f41ccf-c167-413e-a0fd-a61749acbead for instance 01042a8e-a479-4f1d-9239-6fb722bcd33d on hv-cinder-85144 Aug 02 21:48:48.516563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-a8680328-4af3-449a-bf94-6681aa23bb38 req-54e41885-2c10-42b5-b4aa-6710f587a7ea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031213 Aug 02 21:48:48.517578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 436/846] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:48.643914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:48.644775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:48.651723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:48.651908 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:48.652759 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:48.653608 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:48.883506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:48.891507 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:48.893317 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:48.894485 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8b7bc24c-c6a8-4b40-9799-ce343db786c5 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.254811 Aug 02 21:48:48.908205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 411/847] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:48 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:49.919523 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:49.920251 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:49.926410 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:49.926861 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:49.927630 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:49.928101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:50.055163 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:50.063789 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:50.065326 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:50.066493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f4a5489c-709d-431f-83cd-d45d0f2f7667 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.152393 Aug 02 21:48:50.067043 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 437/848] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:49 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:51.088946 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:51.089507 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:51.095923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:51.096399 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:51.097166 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:51.097600 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:51.223380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:51.225645 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:51.232637 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:51.234182 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:51.235349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f160425d-516c-49b6-9ae9-ee2a5e68f37c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.150499 Aug 02 21:48:51.235904 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 412/849] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:51 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:52.258769 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:52.259292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:52.266465 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:52.266923 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:52.267957 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:52.268432 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:52.399528 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:52.408101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:52.409620 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:52.410775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8076ab30-aa55-4c59-a4af-ecd1139d718d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.156126 Aug 02 21:48:52.411337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 438/850] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:52 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:53.433941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:53.434552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:53.441416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:53.441868 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:53.442636 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:53.443077 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:53.578800 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:53.586817 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:53.589523 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:53.590674 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-66ac19a0-af69-48a6-8f6e-8c3f076b317e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.161459 Aug 02 21:48:53.591223 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 413/851] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:53 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:54.614435 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:54.615052 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:54.622201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:54.622661 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:54.623437 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:54.623882 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:54.773674 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:54.783537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:54.785081 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:54.786256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b9981411-5390-4b42-bde9-5a8f3ce4dbc3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.175806 Aug 02 21:48:54.786814 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 439/852] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:54 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:55.810766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:55.811349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:55.817933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:55.818384 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:55.819153 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:55.819590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:55.947013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:55.954926 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:55.956489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:55.957655 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-12329cc4-0a77-4217-9ec5-33e1b2be8d9d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1743 microversion: 2.20 time: 0.151424 Aug 02 21:48:55.958204 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 414/853] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:55 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:56.981123 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:56.981739 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:56.988416 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:56.988876 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:56.989667 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:56.990101 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:57.124781 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:57.133143 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:57.134649 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:57.135814 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e3bd6baa-f4de-4e8f-9660-678e4895aaf8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1743 microversion: 2.20 time: 0.158641 Aug 02 21:48:57.137016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 440/854] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:56 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:58.159099 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:58.159707 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:58.166261 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:58.166709 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:58.167469 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:58.167903 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:58.298663 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:58.306416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:58.307940 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:58.309148 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5d731a48-6857-45cc-bd16-2947ba1d2430 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1743 microversion: 2.20 time: 0.154053 Aug 02 21:48:58.309691 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 415/855] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:58 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:48:58.783387 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-25a33546-529c-4cb8-8aea-f84094b7288e req-400a1869-ae4d-4db3-af14-87caafa5326d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f0e81e-d7e8-45f4-96c5-08aedf7cc9da", "name": "network-vif-plugged", "status": "completed", "tag": "fe08db00-0856-4a99-90d2-bcbf21c1a129"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:48:58.794404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-25a33546-529c-4cb8-8aea-f84094b7288e req-400a1869-ae4d-4db3-af14-87caafa5326d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:58.794886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-25a33546-529c-4cb8-8aea-f84094b7288e req-400a1869-ae4d-4db3-af14-87caafa5326d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:58.806378 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-25a33546-529c-4cb8-8aea-f84094b7288e req-400a1869-ae4d-4db3-af14-87caafa5326d service nova] Creating event network-vif-plugged:fe08db00-0856-4a99-90d2-bcbf21c1a129 for instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da on hv-cinder-85144 Aug 02 21:48:58.811883 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-25a33546-529c-4cb8-8aea-f84094b7288e req-400a1869-ae4d-4db3-af14-87caafa5326d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Aug 02 21:48:58.812776 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 441/856] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:48:59.332363 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:48:59.332999 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:48:59.339915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:59.340404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:59.341161 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:48:59.341595 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:48:59.467409 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:59.475216 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:59.476780 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:48:59.477923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5ff9f83f-191d-417c-8751-f60cbb867009 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1743 microversion: 2.20 time: 0.149592 Aug 02 21:48:59.478470 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 416/857] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:48:59 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:00.502972 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:00.503689 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:00.505642 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:00.511142 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:00.511596 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:00.512406 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:00.512851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:00.645340 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:00.653272 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:00.654757 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:00.655913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-13574d68-60de-4ab9-b081-45f5bdd232c7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1743 microversion: 2.20 time: 0.157831 Aug 02 21:49:00.656503 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 442/858] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:00 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:01.678903 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:01.679520 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:01.681843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:01.687591 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:01.688048 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:01.688847 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:01.689289 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:01.820708 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:01.829240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:01.830884 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:01.832045 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3a858b20-3701-4fb1-8587-c756aa4a366d tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1743 microversion: 2.20 time: 0.157134 Aug 02 21:49:01.832633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 417/859] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:01 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:02.854654 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:02.855389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:02.862596 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:02.863116 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:02.863943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:02.864478 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:03.005166 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:03.014057 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:03.015529 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:03.016813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6598d9c3-7028-4fad-ac51-b1d3362a1886 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.166053 Aug 02 21:49:03.017391 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 443/860] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:02 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:04.040875 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:04.041725 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:04.049473 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:04.049934 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:04.050722 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:04.051168 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:04.189225 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:04.199153 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:04.201775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:04.203307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b64292b0-0cde-48ef-8ba4-538524cec812 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.166405 Aug 02 21:49:04.203866 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 418/861] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:04 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:05.226623 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:05.227167 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:05.233970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:05.234422 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:05.235188 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:05.235627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:05.373352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:05.383058 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:05.384593 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:05.385766 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ec65e7e2-3346-4eb0-913b-d3822bf28adb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.163382 Aug 02 21:49:05.386537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 444/862] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:05 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:06.410522 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:06.411807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:06.419458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:06.419995 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:06.420877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:06.421804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:06.563806 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:06.572957 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:06.575259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:06.576660 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5a7028d9-1100-419c-8d69-1ed2088831cd tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.170154 Aug 02 21:49:06.584606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 419/863] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:06 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:07.600185 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:07.600806 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:07.607512 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:07.607974 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:07.608782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:07.609240 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:07.748616 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:07.757282 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:07.758875 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:07.760170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-16e1958e-89f6-45d0-8463-bb9bfc603424 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.163784 Aug 02 21:49:07.760701 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 445/864] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:07 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:08.783658 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:08.784362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:08.791046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:08.791494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:08.792285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:08.792723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:08.949055 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:08.957411 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:08.958944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:08.960101 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e79837a5-405c-433e-a472-9731cd4a69e3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.180436 Aug 02 21:49:08.960733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 420/865] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:08 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:09.983074 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:09.983687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:09.991201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:09.992031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:09.992867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:09.993309 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:10.139869 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:10.149315 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:10.150757 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:10.153781 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-deba2dc5-af10-49a6-b23d-262d9d0e1639 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.172867 Aug 02 21:49:10.164791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 446/866] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:09 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:11.177218 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:11.177774 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:11.184724 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:11.185281 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:11.186072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:11.186515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:11.338604 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:11.347917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:11.349515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:11.350683 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e90d0fc6-bb4c-4671-9f89-8e8adb0b47bc tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.177682 Aug 02 21:49:11.364647 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 421/867] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:11 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:12.376272 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:12.377716 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:12.384844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:12.385384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:12.386225 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:12.386763 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:12.390105 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=96 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:12.548007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:12.558682 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:12.560871 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:12.563841 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-73d15636-314c-4ba8-a42e-e8916c994ed9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.191113 Aug 02 21:49:12.576954 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 447/868] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:12 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:13.585852 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:13.588493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:13.608980 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:13.609918 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:13.610987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:13.611626 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:13.818059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:13.826652 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:13.828236 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:13.829427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bb30c388-9106-45bc-9cc9-c0018a4a3fb9 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1738 microversion: 2.20 time: 0.247625 Aug 02 21:49:13.829991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 422/869] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:13 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:14.852276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:14.853003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:14.860034 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:14.860585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:14.861431 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:14.861894 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:14.998234 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:15.006236 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:15.007746 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:15.008947 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-78c21c9e-08e6-4c32-be9f-20de0981c50b tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1720 microversion: 2.20 time: 0.160650 Aug 02 21:49:15.009505 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 448/870] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:14 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:16.033267 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:16.033881 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:16.040370 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:16.040827 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:16.041589 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:16.042028 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:16.168989 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:16.176887 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:16.178486 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:16.179641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f2bc1322-7120-4dce-8a07-0c4cba1bf8eb tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1720 microversion: 2.20 time: 0.150347 Aug 02 21:49:16.180219 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 423/871] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:16 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:16.797925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-de0c7350-9c86-4ee6-af61-dd2cb3a51485 req-55fbdf6f-23c5-47fc-b21d-060c878d12c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f0e81e-d7e8-45f4-96c5-08aedf7cc9da", "name": "network-vif-unplugged", "status": "completed", "tag": "fe08db00-0856-4a99-90d2-bcbf21c1a129"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:49:16.807707 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-de0c7350-9c86-4ee6-af61-dd2cb3a51485 req-55fbdf6f-23c5-47fc-b21d-060c878d12c3 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:16.808177 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-de0c7350-9c86-4ee6-af61-dd2cb3a51485 req-55fbdf6f-23c5-47fc-b21d-060c878d12c3 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:16.820331 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-de0c7350-9c86-4ee6-af61-dd2cb3a51485 req-55fbdf6f-23c5-47fc-b21d-060c878d12c3 service nova] Creating event network-vif-unplugged:fe08db00-0856-4a99-90d2-bcbf21c1a129 for instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da on hv-cinder-85144 Aug 02 21:49:16.825900 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-de0c7350-9c86-4ee6-af61-dd2cb3a51485 req-55fbdf6f-23c5-47fc-b21d-060c878d12c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030983 Aug 02 21:49:16.826491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 449/872] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:49:17.201898 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:17.202470 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:17.208972 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:17.209429 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:17.210199 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:17.210640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:17.338911 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:17.347307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:17.348900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:17.350056 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b9711218-c422-4e78-99d9-11942f023383 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1720 microversion: 2.20 time: 0.152236 Aug 02 21:49:17.350615 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 424/873] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:17 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:18.375664 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:18.376564 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:18.383846 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:18.384329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:18.385110 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:18.385550 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:18.520580 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:18.528972 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:18.530461 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:18.531610 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2501dc29-4c93-45e7-accf-589513dc4904 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1723 microversion: 2.20 time: 0.161063 Aug 02 21:49:18.532182 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 450/874] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:18 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:18.553860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5cf1dfdc-6689-44db-8a35-868207f9ee1a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74514248-3389-4c29-8a68-2c5102b6bf5f"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:49:18.556255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5cf1dfdc-6689-44db-8a35-868207f9ee1a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:18.562762 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5cf1dfdc-6689-44db-8a35-868207f9ee1a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:18.563214 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5cf1dfdc-6689-44db-8a35-868207f9ee1a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:18.564020 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5cf1dfdc-6689-44db-8a35-868207f9ee1a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:18.564499 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5cf1dfdc-6689-44db-8a35-868207f9ee1a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:18.836199 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5cf1dfdc-6689-44db-8a35-868207f9ee1a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286344 Aug 02 21:49:18.837106 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 425/875] 10.222.0.57 () {62 vars in 1364 bytes} [Tue Aug 2 21:49:18 2022] POST /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 21:49:18.956592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-27cddefb-818b-49bb-8c76-e475962844b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:18.957089 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-27cddefb-818b-49bb-8c76-e475962844b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:18.963017 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-27cddefb-818b-49bb-8c76-e475962844b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:18.963469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-27cddefb-818b-49bb-8c76-e475962844b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:18.964266 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-27cddefb-818b-49bb-8c76-e475962844b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:18.964706 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-27cddefb-818b-49bb-8c76-e475962844b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:19.208537 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-27cddefb-818b-49bb-8c76-e475962844b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "DELETE /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/os-volume_attachments/74514248-3389-4c29-8a68-2c5102b6bf5f" status: 202 len: 0 microversion: 2.20 time: 0.256182 Aug 02 21:49:19.209132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 451/876] 10.222.0.57 () {60 vars in 1457 bytes} [Tue Aug 2 21:49:18 2022] DELETE /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/os-volume_attachments/74514248-3389-4c29-8a68-2c5102b6bf5f => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:49:19.266815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-192bbd7f-3b1e-4cb7-8f62-cad7b207b9c6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:49:19.267528 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-192bbd7f-3b1e-4cb7-8f62-cad7b207b9c6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:19.273993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-192bbd7f-3b1e-4cb7-8f62-cad7b207b9c6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:19.274450 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-192bbd7f-3b1e-4cb7-8f62-cad7b207b9c6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:19.275221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-192bbd7f-3b1e-4cb7-8f62-cad7b207b9c6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:19.275659 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-192bbd7f-3b1e-4cb7-8f62-cad7b207b9c6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:19.304333 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-192bbd7f-3b1e-4cb7-8f62-cad7b207b9c6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124840) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 21:49:19.326346 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:19.381161 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-192bbd7f-3b1e-4cb7-8f62-cad7b207b9c6 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "POST /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/action" status: 202 len: 0 microversion: 2.20 time: 0.118366 Aug 02 21:49:19.381949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 426/877] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 2 21:49:19 2022] POST /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:49:19.390521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:19.391210 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:19.398865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:19.399381 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:19.400163 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:19.400605 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:19.530224 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:19.537983 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:19.539473 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:19.540644 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-855c3ac6-0dae-4b7d-a0f2-cb77e9dd9d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1671 microversion: 2.20 time: 0.154097 Aug 02 21:49:19.541189 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 452/878] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:19 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:20.563277 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:20.563896 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:20.570156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:20.570613 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:20.571378 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:20.571824 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:20.707948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:20.715923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:20.718086 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:20.719232 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5211e377-cac8-430d-ac2f-d99e5b1a1c6a tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1673 microversion: 2.20 time: 0.160425 Aug 02 21:49:20.719793 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 427/879] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:20 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:21.742195 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:21.742832 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:21.749321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:21.749773 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:21.750533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:21.750961 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:21.891569 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:21.900058 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:21.901575 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:21.902735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8c7ceb1d-a612-4547-bfcb-209fab611094 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.164376 Aug 02 21:49:21.904164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 453/880] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:21 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:22.930435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:22.931912 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:22.940393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:22.940846 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:22.941628 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:22.942066 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:23.074829 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:23.082691 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:23.084258 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:23.085412 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5f1df86a-5db5-4d1c-af53-4266600a01c4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.161074 Aug 02 21:49:23.085962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 428/881] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:22 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:24.109011 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:24.110626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:24.118452 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:24.119389 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:24.120768 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:24.121446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:24.257434 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:24.266006 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:24.267515 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:24.268964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b729da33-5a39-490a-a589-942c4273d121 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.164668 Aug 02 21:49:24.269526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 454/882] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:24 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:25.291970 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:25.292656 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:25.301846 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:25.302326 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:25.303186 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:25.304195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:25.442451 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:25.450603 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:25.452158 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:25.453347 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-821c3605-838f-4e5e-8472-153e9049a581 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.166060 Aug 02 21:49:25.453911 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 429/883] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:25 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:26.478160 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:26.478813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:26.485507 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:26.485964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:26.486750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:26.487194 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:26.621765 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:26.630250 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:26.631925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:26.633492 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a88ac458-213f-4af7-8464-8d6212d914d3 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.159194 Aug 02 21:49:26.634056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 455/884] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:26 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:27.657536 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:27.658190 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:27.675751 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:27.676235 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:27.677036 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:27.677475 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:27.812734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:27.827474 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:27.829792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:27.830970 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-70f1ee54-c1f4-4e4b-910b-fb842f555401 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.178025 Aug 02 21:49:27.831530 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 430/885] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:27 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:28.855791 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:28.856460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:28.875892 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:28.876416 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:28.877206 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:28.877644 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:29.030168 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:29.038536 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:29.040035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:29.041256 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c1372c7a-2c80-417c-9fdb-836902128115 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.190713 Aug 02 21:49:29.041809 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 456/886] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:28 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:30.066740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:30.067355 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:30.074075 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:30.074534 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:30.075339 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:30.075789 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:30.213767 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:30.226427 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:30.228250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:30.229571 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9877559b-68f0-4002-b6b9-15ef0193ebc2 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.167024 Aug 02 21:49:30.240755 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 431/887] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:30 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:31.254415 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:31.255012 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:31.257496 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=30 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:31.263574 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:31.264041 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:31.264872 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:31.265571 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:31.413371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:31.421208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:31.422714 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:31.423868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-461fe8fa-03ca-4239-9c37-b3549c658d32 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.173383 Aug 02 21:49:31.424460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 457/888] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:31 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:32.447047 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:32.447668 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:32.449962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:32.455413 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:32.455847 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:32.456657 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:32.457097 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:32.602760 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:32.614435 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:32.615998 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:32.617203 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-86f49c62-239e-490c-8897-736867b1280f tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.174125 Aug 02 21:49:32.617767 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 432/889] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:32 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:33.641138 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:33.641818 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:33.648413 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:33.648874 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:33.649649 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:33.650098 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:33.777773 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:33.786127 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:33.787655 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:33.788844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b7f3e017-7a38-46af-a16c-87b794d6be00 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.151626 Aug 02 21:49:33.789409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 458/890] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:33 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:34.812669 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:34.813291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:34.819792 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:34.820282 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:34.821042 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:34.821502 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:34.962668 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:34.971205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:34.972776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:34.973946 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e53104dd-a49f-43be-b937-393bc2731135 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.165262 Aug 02 21:49:34.974501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 433/891] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:34 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:35.997109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:35.998287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:36.005540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:36.006054 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:36.006912 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:36.007407 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:36.140906 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:36.149107 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:36.150639 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:36.151813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5be56042-c663-4b64-a43c-451ade927153 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.159025 Aug 02 21:49:36.152409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 459/892] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:35 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:37.178193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:37.178737 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:37.185201 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:37.185639 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:37.186484 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:37.186929 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:37.317333 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:37.325237 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:37.327267 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:37.328438 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9f982975-dd29-4d9d-addb-56b218a13c1e tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.155927 Aug 02 21:49:37.328992 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 434/893] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:37 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:38.353132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:38.353766 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:38.362553 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:38.363009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:38.365010 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:38.365010 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:38.544001 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:38.552867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:38.554679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:38.555844 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-93327715-7837-4826-895f-200e53556314 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.206705 Aug 02 21:49:38.556444 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 460/894] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:38 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:39.585892 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:39.586584 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:39.593635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:39.594092 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:39.594868 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:39.595312 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:39.721556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:39.729665 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:39.731228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:39.732428 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e930918c-f676-4421-9ac4-7624cdb60a35 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.150526 Aug 02 21:49:39.732987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 435/895] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:39 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:40.755466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:40.756079 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:40.762625 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:40.763704 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:40.764513 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:40.764956 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:41.059666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:41.063657 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:41.069125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:41.070609 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:41.071767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a94513f7-832a-4171-b706-1acea9f16f66 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.320180 Aug 02 21:49:41.072350 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 461/896] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:40 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:42.095522 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:42.096066 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:42.102680 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:42.103135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:42.103906 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:42.104383 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:42.230057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:42.237966 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:42.239522 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:42.240715 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7f850f5c-2ae3-4f34-a36c-ddfbd40425e4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.149757 Aug 02 21:49:42.241282 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 436/897] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:42 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:42.942490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-f4e35c97-fd36-4a43-a53a-485c4ce1683e req-346c0cbf-2deb-4dff-848f-c58475d13313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f0e81e-d7e8-45f4-96c5-08aedf7cc9da", "name": "network-vif-plugged", "status": "completed", "tag": "fe08db00-0856-4a99-90d2-bcbf21c1a129"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:49:42.956532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-f4e35c97-fd36-4a43-a53a-485c4ce1683e req-346c0cbf-2deb-4dff-848f-c58475d13313 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:42.957288 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-f4e35c97-fd36-4a43-a53a-485c4ce1683e req-346c0cbf-2deb-4dff-848f-c58475d13313 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:42.970208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-f4e35c97-fd36-4a43-a53a-485c4ce1683e req-346c0cbf-2deb-4dff-848f-c58475d13313 service nova] Creating event network-vif-plugged:fe08db00-0856-4a99-90d2-bcbf21c1a129 for instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da on hv-cinder-85144 Aug 02 21:49:42.975234 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-f4e35c97-fd36-4a43-a53a-485c4ce1683e req-346c0cbf-2deb-4dff-848f-c58475d13313 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036392 Aug 02 21:49:42.975837 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 462/898] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:49:43.262910 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:43.263586 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:43.270910 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:43.271362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:43.272174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:43.272617 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:43.400613 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:43.408583 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:43.410132 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:43.411292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b06bf43c-eb6b-47b7-bb78-38748579c784 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.152435 Aug 02 21:49:43.411860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 437/899] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:43 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:44.435853 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:44.436581 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:44.442744 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:44.443193 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:44.443956 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:44.444421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:44.574044 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:44.581808 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:44.583289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:44.584473 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-dde04705-dc86-4467-a866-a9662f6e4829 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.153482 Aug 02 21:49:44.585014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 463/900] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:44 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:45.607150 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:45.607766 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:45.614492 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:45.614952 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:45.615755 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:45.616217 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:45.750135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:45.758237 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:45.759788 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:45.760971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0f3681af-5723-44cc-8f33-59e0626297ec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1729 microversion: 2.20 time: 0.157881 Aug 02 21:49:45.761535 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 438/901] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:45 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:46.784477 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:46.785090 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:46.791551 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:46.791996 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:46.792799 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:46.793233 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:46.922599 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:46.930967 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:46.932508 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:49:46.933866 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0f15f44f-e1ec-439e-bf82-62b7d98a3ce4 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1716 microversion: 2.20 time: 0.153232 Aug 02 21:49:46.934383 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 464/902] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:49:46 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:49:48.885930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c453e8f1-4e08-409a-bbfd-12d70ab38151 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:48.886437 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c453e8f1-4e08-409a-bbfd-12d70ab38151 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:48.893466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c453e8f1-4e08-409a-bbfd-12d70ab38151 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:48.893912 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c453e8f1-4e08-409a-bbfd-12d70ab38151 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:48.894937 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c453e8f1-4e08-409a-bbfd-12d70ab38151 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:48.895374 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c453e8f1-4e08-409a-bbfd-12d70ab38151 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:48.917768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c453e8f1-4e08-409a-bbfd-12d70ab38151 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/ips" status: 200 len: 145 microversion: 2.1 time: 0.035832 Aug 02 21:49:48.918322 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 439/903] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:49:48 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:49:50.239746 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6d2d3f73-bfbc-4515-be3f-96471e90790f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "165e8fb2-8a5c-4c43-b633-49954b805b00"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:49:50.242232 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6d2d3f73-bfbc-4515-be3f-96471e90790f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:50.249268 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6d2d3f73-bfbc-4515-be3f-96471e90790f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:50.249724 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6d2d3f73-bfbc-4515-be3f-96471e90790f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:50.250500 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6d2d3f73-bfbc-4515-be3f-96471e90790f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:50.250945 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6d2d3f73-bfbc-4515-be3f-96471e90790f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:50.515962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6d2d3f73-bfbc-4515-be3f-96471e90790f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279933 Aug 02 21:49:50.516593 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 465/904] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:49:50 2022] POST /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:49:58.056723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ba38fd1b-91a6-4924-ad2b-4a571c3ad69f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:58.059501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ba38fd1b-91a6-4924-ad2b-4a571c3ad69f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:58.066682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ba38fd1b-91a6-4924-ad2b-4a571c3ad69f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:58.067135 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ba38fd1b-91a6-4924-ad2b-4a571c3ad69f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:58.067906 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ba38fd1b-91a6-4924-ad2b-4a571c3ad69f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:58.068509 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ba38fd1b-91a6-4924-ad2b-4a571c3ad69f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:58.070927 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:58.103665 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ba38fd1b-91a6-4924-ad2b-4a571c3ad69f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051339 Aug 02 21:49:58.104307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 440/905] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:49:58 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:49:58.115941 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-04551976-4119-44c7-9c4b-99ce52d6f8d5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:49:58.116556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-04551976-4119-44c7-9c4b-99ce52d6f8d5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:58.123797 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-04551976-4119-44c7-9c4b-99ce52d6f8d5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:58.124285 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-04551976-4119-44c7-9c4b-99ce52d6f8d5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:58.125063 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-04551976-4119-44c7-9c4b-99ce52d6f8d5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:58.125506 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-04551976-4119-44c7-9c4b-99ce52d6f8d5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:58.160382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-04551976-4119-44c7-9c4b-99ce52d6f8d5 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/165e8fb2-8a5c-4c43-b633-49954b805b00" status: 200 len: 194 microversion: 2.1 time: 0.048616 Aug 02 21:49:58.161017 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 466/906] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 2 21:49:58 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/165e8fb2-8a5c-4c43-b633-49954b805b00 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:49:59.481090 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-89eb67a7-5a6f-4b52-b615-968444d41ab1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5487577a-3756-44e6-aa50-5dbe5d456a65"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:49:59.484266 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-89eb67a7-5a6f-4b52-b615-968444d41ab1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:49:59.490664 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-89eb67a7-5a6f-4b52-b615-968444d41ab1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:59.491112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-89eb67a7-5a6f-4b52-b615-968444d41ab1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:59.491886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-89eb67a7-5a6f-4b52-b615-968444d41ab1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:49:59.492356 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-89eb67a7-5a6f-4b52-b615-968444d41ab1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:49:59.858757 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-89eb67a7-5a6f-4b52-b615-968444d41ab1 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "POST /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381575 Aug 02 21:49:59.859353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 441/907] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:49:59 2022] POST /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:04.526724 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1cf7b28d-b46f-4ba7-9eec-acb52b51cd6d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:04.527242 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-1cf7b28d-b46f-4ba7-9eec-acb52b51cd6d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:04.530263 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-79074fce-8d9a-4d8c-9c42-7d6d0101346c req-a1cbd59e-533f-4561-b0ff-ca5c82895540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7248b87b-aba6-40d9-b464-f824c44b1672", "tag": "5a4b7f07-13e7-408e-b7d9-3162f37424ed"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:04.530886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=20 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:04.535085 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1cf7b28d-b46f-4ba7-9eec-acb52b51cd6d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:04.535547 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1cf7b28d-b46f-4ba7-9eec-acb52b51cd6d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:04.536362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1cf7b28d-b46f-4ba7-9eec-acb52b51cd6d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:04.536887 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=20 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:04.537023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1cf7b28d-b46f-4ba7-9eec-acb52b51cd6d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:04.543108 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-79074fce-8d9a-4d8c-9c42-7d6d0101346c req-a1cbd59e-533f-4561-b0ff-ca5c82895540 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:04.543566 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-79074fce-8d9a-4d8c-9c42-7d6d0101346c req-a1cbd59e-533f-4561-b0ff-ca5c82895540 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:04.555079 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-79074fce-8d9a-4d8c-9c42-7d6d0101346c req-a1cbd59e-533f-4561-b0ff-ca5c82895540 service nova] Creating event network-changed:5a4b7f07-13e7-408e-b7d9-3162f37424ed for instance 7248b87b-aba6-40d9-b464-f824c44b1672 on hv-cinder-85144 Aug 02 21:50:04.560828 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-79074fce-8d9a-4d8c-9c42-7d6d0101346c req-a1cbd59e-533f-4561-b0ff-ca5c82895540 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034937 Aug 02 21:50:04.561633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 442/908] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:04.564032 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-1cf7b28d-b46f-4ba7-9eec-acb52b51cd6d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:50:04.642678 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1cf7b28d-b46f-4ba7-9eec-acb52b51cd6d tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 204 len: 0 microversion: 2.1 time: 0.119668 Aug 02 21:50:04.643501 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 467/909] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:04 2022] DELETE /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:50:04.652198 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6e2aca5f-6e7b-4a76-8c49-cff687e6b0ee tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:04.652906 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6e2aca5f-6e7b-4a76-8c49-cff687e6b0ee tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:04.659580 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6e2aca5f-6e7b-4a76-8c49-cff687e6b0ee tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:04.660038 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6e2aca5f-6e7b-4a76-8c49-cff687e6b0ee tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:04.660833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6e2aca5f-6e7b-4a76-8c49-cff687e6b0ee tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:04.661274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6e2aca5f-6e7b-4a76-8c49-cff687e6b0ee tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:04.794617 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6e2aca5f-6e7b-4a76-8c49-cff687e6b0ee tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:04.804477 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6e2aca5f-6e7b-4a76-8c49-cff687e6b0ee tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.156444 Aug 02 21:50:04.816551 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 443/910] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:04 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:05.828152 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a4261799-fd28-4042-976e-ccde2f7f7fd6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:05.828888 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a4261799-fd28-4042-976e-ccde2f7f7fd6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:05.835505 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a4261799-fd28-4042-976e-ccde2f7f7fd6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:05.835903 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a4261799-fd28-4042-976e-ccde2f7f7fd6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:05.836705 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a4261799-fd28-4042-976e-ccde2f7f7fd6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:05.837149 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a4261799-fd28-4042-976e-ccde2f7f7fd6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:06.017461 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a4261799-fd28-4042-976e-ccde2f7f7fd6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:06.025188 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a4261799-fd28-4042-976e-ccde2f7f7fd6 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.201844 Aug 02 21:50:06.025750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 468/911] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:05 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:07.046721 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fdd958b1-9283-4930-b71e-2ba1d721aa55 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:07.047348 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fdd958b1-9283-4930-b71e-2ba1d721aa55 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:07.053865 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fdd958b1-9283-4930-b71e-2ba1d721aa55 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:07.054323 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fdd958b1-9283-4930-b71e-2ba1d721aa55 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:07.055097 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fdd958b1-9283-4930-b71e-2ba1d721aa55 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:07.055544 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fdd958b1-9283-4930-b71e-2ba1d721aa55 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:07.193213 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-fdd958b1-9283-4930-b71e-2ba1d721aa55 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:07.201216 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fdd958b1-9283-4930-b71e-2ba1d721aa55 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.158676 Aug 02 21:50:07.201790 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 444/912] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:07 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:08.222451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-60410947-1cc0-449d-a79d-0b7159117ce8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:08.223614 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-60410947-1cc0-449d-a79d-0b7159117ce8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:08.230857 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60410947-1cc0-449d-a79d-0b7159117ce8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:08.231313 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60410947-1cc0-449d-a79d-0b7159117ce8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:08.232921 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60410947-1cc0-449d-a79d-0b7159117ce8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:08.233576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-60410947-1cc0-449d-a79d-0b7159117ce8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:08.372409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-60410947-1cc0-449d-a79d-0b7159117ce8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:08.379912 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-60410947-1cc0-449d-a79d-0b7159117ce8 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.161528 Aug 02 21:50:08.380486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 469/913] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:08 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:09.401181 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b1521157-db57-499c-a81c-5e1c304a992f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:09.401833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b1521157-db57-499c-a81c-5e1c304a992f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:09.409095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b1521157-db57-499c-a81c-5e1c304a992f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:09.409556 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b1521157-db57-499c-a81c-5e1c304a992f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:09.410330 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b1521157-db57-499c-a81c-5e1c304a992f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:09.410782 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b1521157-db57-499c-a81c-5e1c304a992f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:09.538650 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b1521157-db57-499c-a81c-5e1c304a992f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:09.546869 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b1521157-db57-499c-a81c-5e1c304a992f tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.149696 Aug 02 21:50:09.547430 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 445/914] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:09 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:10.555126 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e549112d-7951-4264-91fa-7e973f23684d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:10.557411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e549112d-7951-4264-91fa-7e973f23684d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:10.563827 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e549112d-7951-4264-91fa-7e973f23684d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.564329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e549112d-7951-4264-91fa-7e973f23684d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.565123 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e549112d-7951-4264-91fa-7e973f23684d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.565569 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e549112d-7951-4264-91fa-7e973f23684d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.568860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-45ce1061-f760-4ba5-b575-3cca5cf9fd58 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:10.569358 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-45ce1061-f760-4ba5-b575-3cca5cf9fd58 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:10.576417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-45ce1061-f760-4ba5-b575-3cca5cf9fd58 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.576867 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-45ce1061-f760-4ba5-b575-3cca5cf9fd58 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.577826 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-45ce1061-f760-4ba5-b575-3cca5cf9fd58 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.578268 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-45ce1061-f760-4ba5-b575-3cca5cf9fd58 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.600592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e549112d-7951-4264-91fa-7e973f23684d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049139 Aug 02 21:50:10.607794 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 470/915] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:50:10 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:10.747592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5974cd46-62a6-4d50-817d-2f028f9db5db tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:10.748094 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5974cd46-62a6-4d50-817d-2f028f9db5db tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:10.754109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5974cd46-62a6-4d50-817d-2f028f9db5db tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.754563 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5974cd46-62a6-4d50-817d-2f028f9db5db tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.755342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5974cd46-62a6-4d50-817d-2f028f9db5db tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.755787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5974cd46-62a6-4d50-817d-2f028f9db5db tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.782630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-45ce1061-f760-4ba5-b575-3cca5cf9fd58 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:10.785332 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5974cd46-62a6-4d50-817d-2f028f9db5db tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/165e8fb2-8a5c-4c43-b633-49954b805b00" status: 200 len: 194 microversion: 2.1 time: 0.041784 Aug 02 21:50:10.786152 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 471/916] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 2 21:50:10 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/165e8fb2-8a5c-4c43-b633-49954b805b00 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:50:10.791151 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-45ce1061-f760-4ba5-b575-3cca5cf9fd58 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1565 microversion: 2.1 time: 0.226400 Aug 02 21:50:10.793864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 446/917] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:10 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1565 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:10.796885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e0e85f6f-c08e-401d-baca-3ef901045850 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:10.797414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e0e85f6f-c08e-401d-baca-3ef901045850 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:10.806759 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0e85f6f-c08e-401d-baca-3ef901045850 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.806759 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0e85f6f-c08e-401d-baca-3ef901045850 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.806759 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0e85f6f-c08e-401d-baca-3ef901045850 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.806759 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0e85f6f-c08e-401d-baca-3ef901045850 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.899827 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-e0e85f6f-c08e-401d-baca-3ef901045850 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lazy-loading 'services' on Instance uuid f49a1721-ee1f-4401-abbf-ce8fa780dbfe {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:50:10.900859 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-d099f12b-5b5f-40f0-aa09-626ecff14c78 req-28e8a770-cfb4-4e27-b88e-bc7190be0ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7248b87b-aba6-40d9-b464-f824c44b1672", "name": "network-vif-deleted", "tag": "5a4b7f07-13e7-408e-b7d9-3162f37424ed"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:10.922051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-d099f12b-5b5f-40f0-aa09-626ecff14c78 req-28e8a770-cfb4-4e27-b88e-bc7190be0ab2 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:10.922305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-d099f12b-5b5f-40f0-aa09-626ecff14c78 req-28e8a770-cfb4-4e27-b88e-bc7190be0ab2 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:10.942194 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-d099f12b-5b5f-40f0-aa09-626ecff14c78 req-28e8a770-cfb4-4e27-b88e-bc7190be0ab2 service nova] Creating event network-vif-deleted:5a4b7f07-13e7-408e-b7d9-3162f37424ed for instance 7248b87b-aba6-40d9-b464-f824c44b1672 on hv-cinder-85144 Aug 02 21:50:10.949203 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-d099f12b-5b5f-40f0-aa09-626ecff14c78 req-28e8a770-cfb4-4e27-b88e-bc7190be0ab2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052073 Aug 02 21:50:10.953491 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 447/918] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:50:10.987485 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e0e85f6f-c08e-401d-baca-3ef901045850 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/165e8fb2-8a5c-4c43-b633-49954b805b00" status: 202 len: 0 microversion: 2.1 time: 0.195185 Aug 02 21:50:10.988066 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 472/919] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:50:10 2022] DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/165e8fb2-8a5c-4c43-b633-49954b805b00 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 21:50:11.816356 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb4fecb5-0f86-4238-ad82-61dcbbe42b45 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:11.817065 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bb4fecb5-0f86-4238-ad82-61dcbbe42b45 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:11.823277 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb4fecb5-0f86-4238-ad82-61dcbbe42b45 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:11.823730 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb4fecb5-0f86-4238-ad82-61dcbbe42b45 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:11.824561 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb4fecb5-0f86-4238-ad82-61dcbbe42b45 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:11.825004 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb4fecb5-0f86-4238-ad82-61dcbbe42b45 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:11.890936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb4fecb5-0f86-4238-ad82-61dcbbe42b45 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:11.899023 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bb4fecb5-0f86-4238-ad82-61dcbbe42b45 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1217 microversion: 2.1 time: 0.087337 Aug 02 21:50:11.899597 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 448/920] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:11 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:12.921192 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:12.922624 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:12.930765 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:12.931276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:12.932451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:12.932893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:12.946566 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2019685908", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-625758165", "security_groups": [{"name": "tempest-secgroup-smoke-810633011"}], "block_device_mapping_v2": [{"uuid": "dfe32758-7761-4e8f-b215-7ef38f9d621b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3520a454-3079-4cee-a49b-0583c4633c25"}]}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:12.967406 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:12.967845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:12.968337 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lazy-loading 'fault' on Instance uuid 7248b87b-aba6-40d9-b464-f824c44b1672 {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:50:12.971362 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:13.016042 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228eefac4dab4b5d937bf66ea6e0eb8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94861fe088e4dc091bfa76d5a100fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:13.024352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c6e4adf6-67a7-40e0-9744-eca9c96116a3 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 200 len: 1222 microversion: 2.1 time: 0.108372 Aug 02 21:50:13.024927 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 473/921] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:12 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:13.071885 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] validate_networks() for [('3520a454-3079-4cee-a49b-0583c4633c25', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:50:13.162895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-521514ab-1de9-488b-84c4-57c09c05a521 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:13.163390 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-521514ab-1de9-488b-84c4-57c09c05a521 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:13.169290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-521514ab-1de9-488b-84c4-57c09c05a521 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:13.169786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-521514ab-1de9-488b-84c4-57c09c05a521 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:13.170550 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-521514ab-1de9-488b-84c4-57c09c05a521 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:13.170983 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-521514ab-1de9-488b-84c4-57c09c05a521 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:13.198673 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-521514ab-1de9-488b-84c4-57c09c05a521 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/5487577a-3756-44e6-aa50-5dbe5d456a65" status: 200 len: 194 microversion: 2.1 time: 0.039700 Aug 02 21:50:13.199244 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 474/922] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 2 21:50:13 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/5487577a-3756-44e6-aa50-5dbe5d456a65 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:50:13.209937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e4f9fba4-7415-4372-affa-091088b09a58 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:13.210437 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e4f9fba4-7415-4372-affa-091088b09a58 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:13.216620 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e4f9fba4-7415-4372-affa-091088b09a58 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:13.217084 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e4f9fba4-7415-4372-affa-091088b09a58 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:13.217854 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e4f9fba4-7415-4372-affa-091088b09a58 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:13.218291 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e4f9fba4-7415-4372-affa-091088b09a58 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:13.323285 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-e4f9fba4-7415-4372-affa-091088b09a58 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lazy-loading 'services' on Instance uuid f49a1721-ee1f-4401-abbf-ce8fa780dbfe {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:50:13.434878 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e4f9fba4-7415-4372-affa-091088b09a58 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/5487577a-3756-44e6-aa50-5dbe5d456a65" status: 202 len: 0 microversion: 2.1 time: 0.228518 Aug 02 21:50:13.435788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 475/923] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:50:13 2022] DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments/5487577a-3756-44e6-aa50-5dbe5d456a65 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 21:50:13.526555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:50:13.527009 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:50:13.527494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:50:13.527912 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:50:13.528363 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:50:13.541827 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:13.542489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:13.543478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:13.544244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:13.565628 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Getting quotas for project 0bed6dd5430c4c9983aff2e2f261f5a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:50:13.571562 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Getting quotas for user 5377fd0bccf748dda1d0192080253dcf and project 0bed6dd5430c4c9983aff2e2f261f5a4. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:50:13.631280 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:50:13.633434 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dfe32758-7761-4e8f-b215-7ef38f9d621b',volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:50:13.759395 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-36c1e142-f892-4f0d-b927-fdeeb02e9127 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816860 Aug 02 21:50:13.759955 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 449/924] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:50:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:50:13.772246 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1c808120-57f1-4cb6-b9f4-a2c8c9c86be6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:13.773057 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-1c808120-57f1-4cb6-b9f4-a2c8c9c86be6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:13.833760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-1c808120-57f1-4cb6-b9f4-a2c8c9c86be6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:13.840506 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1c808120-57f1-4cb6-b9f4-a2c8c9c86be6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1094 microversion: 2.1 time: 0.072798 Aug 02 21:50:13.841095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 476/925] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:13 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:14.047815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:14.050579 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] [instance: 7248b87b-aba6-40d9-b464-f824c44b1672] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:14.059378 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.060712 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.061679 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.062120 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.076806 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] HTTP exception thrown: Instance 7248b87b-aba6-40d9-b464-f824c44b1672 could not be found. Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Request method failure captured: Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 HTTP/1.1 Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zptj3lsMvCYsx9KDham2Xgus8ob5ggNRqBiYk_GPRU7lp_u0b9CoFccuPZ-bZmWPZGBH1DiPhNRep5QF1q2gIEpxbm8dTQFEF4s7oxEpDaPnxaKqXTKh_IwCFFyGIiBWGrsYH_rkqU3JeqPYj2WYEEJpAEs1xBtpqSTyCsR4gaigjc Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: e94861fe088e4dc091bfa76d5a100fd5 Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-TestShelveInstance-954827440 Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:14.078464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e94861fe088e4dc091bfa76d5a100fd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e94861fe088e4dc091bfa76d5a100fd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e94861fe088e4dc091bfa76d5a100fd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e94861fe088e4dc091bfa76d5a100fd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-TestShelveInstance-954827440 Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: e94861fe088e4dc091bfa76d5a100fd5 Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-TestShelveInstance-954827440 Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-TestShelveInstance-954827440-project Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 228eefac4dab4b5d937bf66ea6e0eb8e Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-TestShelveInstance-954827440-project Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 7248b87b-aba6-40d9-b464-f824c44b1672 could not be found. Aug 02 21:50:14.080082 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '7248b87b-aba6-40d9-b464-f824c44b1672'} Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7248b87b-aba6-40d9-b464-f824c44b1672 could not be found. Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:14.080925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7248b87b-aba6-40d9-b464-f824c44b1672 could not be found. Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7248b87b-aba6-40d9-b464-f824c44b1672 could not be found. Aug 02 21:50:14.082179 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:14.084715 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Returning 404 to user: Instance 7248b87b-aba6-40d9-b464-f824c44b1672 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:14.085569 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8e94a619-ef38-4aee-8a32-4d1ed2be7555 tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672" status: 404 len: 111 microversion: 2.1 time: 0.043624 Aug 02 21:50:14.086120 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 450/926] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:14 2022] GET /compute/v2.1/servers/7248b87b-aba6-40d9-b464-f824c44b1672 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:14.255328 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-44f6b551-1194-4648-bfec-27fed0b41b4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] Calling method '.version_select at 0x7ff55b73fdc0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:14.279834 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-44f6b551-1194-4648-bfec-27fed0b41b4c tempest-TestShelveInstance-954827440 tempest-TestShelveInstance-954827440-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-644181576" status: 202 len: 0 microversion: 2.1 time: 0.028387 Aug 02 21:50:14.280445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 477/927] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 2 21:50:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-644181576 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:50:14.614520 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-736c50a3-c264-430b-b52b-161831ef9f25 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:14.616798 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-736c50a3-c264-430b-b52b-161831ef9f25 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:14.622740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-736c50a3-c264-430b-b52b-161831ef9f25 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.623191 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-736c50a3-c264-430b-b52b-161831ef9f25 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.623954 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-736c50a3-c264-430b-b52b-161831ef9f25 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.624416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-736c50a3-c264-430b-b52b-161831ef9f25 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.653909 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-736c50a3-c264-430b-b52b-161831ef9f25 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043221 Aug 02 21:50:14.655190 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 451/928] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:50:14 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:50:14.773635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0577dc2b-29bf-4aa5-b945-32a4b3719979 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:14.775822 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0577dc2b-29bf-4aa5-b945-32a4b3719979 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:14.783163 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0577dc2b-29bf-4aa5-b945-32a4b3719979 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.783622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0577dc2b-29bf-4aa5-b945-32a4b3719979 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.784493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0577dc2b-29bf-4aa5-b945-32a4b3719979 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.785162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0577dc2b-29bf-4aa5-b945-32a4b3719979 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.815567 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0577dc2b-29bf-4aa5-b945-32a4b3719979 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045943 Aug 02 21:50:14.816431 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 478/929] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:50:14 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:50:14.863151 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-54e10a11-6d70-4bc5-bbde-2a725f90be92 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:14.865271 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-54e10a11-6d70-4bc5-bbde-2a725f90be92 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:14.871537 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-54e10a11-6d70-4bc5-bbde-2a725f90be92 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.872214 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-54e10a11-6d70-4bc5-bbde-2a725f90be92 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.874231 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-54e10a11-6d70-4bc5-bbde-2a725f90be92 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.874831 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-54e10a11-6d70-4bc5-bbde-2a725f90be92 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.884758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a2ba9b4a-d1aa-41df-a9da-25004290128f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:14.885629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a2ba9b4a-d1aa-41df-a9da-25004290128f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:14.899237 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a2ba9b4a-d1aa-41df-a9da-25004290128f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.899691 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a2ba9b4a-d1aa-41df-a9da-25004290128f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.900565 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a2ba9b4a-d1aa-41df-a9da-25004290128f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:14.901167 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a2ba9b4a-d1aa-41df-a9da-25004290128f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:14.929621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a2ba9b4a-d1aa-41df-a9da-25004290128f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:50:15.014314 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a2ba9b4a-d1aa-41df-a9da-25004290128f tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 204 len: 0 microversion: 2.1 time: 0.132684 Aug 02 21:50:15.014921 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 479/930] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:14 2022] DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 21:50:15.026267 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3168aa65-be44-48f6-aa0f-032dd632f90d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:15.026978 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3168aa65-be44-48f6-aa0f-032dd632f90d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:15.033119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3168aa65-be44-48f6-aa0f-032dd632f90d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:15.033579 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3168aa65-be44-48f6-aa0f-032dd632f90d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:15.034388 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3168aa65-be44-48f6-aa0f-032dd632f90d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:15.034830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3168aa65-be44-48f6-aa0f-032dd632f90d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:15.050051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-54e10a11-6d70-4bc5-bbde-2a725f90be92 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:15.059202 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-54e10a11-6d70-4bc5-bbde-2a725f90be92 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1200 microversion: 2.1 time: 0.201699 Aug 02 21:50:15.059789 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 452/931] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:14 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1200 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:15.168033 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3168aa65-be44-48f6-aa0f-032dd632f90d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:15.176284 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3168aa65-be44-48f6-aa0f-032dd632f90d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1672 microversion: 2.1 time: 0.156567 Aug 02 21:50:15.177087 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 480/932] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:15 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:16.081565 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-99a380f3-fa34-450f-89f7-dc698e04379d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:16.082301 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-99a380f3-fa34-450f-89f7-dc698e04379d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:16.089370 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-99a380f3-fa34-450f-89f7-dc698e04379d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:16.090013 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-99a380f3-fa34-450f-89f7-dc698e04379d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:16.090791 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-99a380f3-fa34-450f-89f7-dc698e04379d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:16.091223 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-99a380f3-fa34-450f-89f7-dc698e04379d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:16.198346 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4aee09e7-742e-4c73-9a88-f1f6c7c67d20 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:16.199612 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4aee09e7-742e-4c73-9a88-f1f6c7c67d20 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:16.206589 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4aee09e7-742e-4c73-9a88-f1f6c7c67d20 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:16.207486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4aee09e7-742e-4c73-9a88-f1f6c7c67d20 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:16.208573 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4aee09e7-742e-4c73-9a88-f1f6c7c67d20 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:16.209066 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4aee09e7-742e-4c73-9a88-f1f6c7c67d20 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:16.351987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4aee09e7-742e-4c73-9a88-f1f6c7c67d20 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:16.362227 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4aee09e7-742e-4c73-9a88-f1f6c7c67d20 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1672 microversion: 2.1 time: 0.167742 Aug 02 21:50:16.363427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 481/933] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:16 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:16.384189 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-99a380f3-fa34-450f-89f7-dc698e04379d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:16.392418 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-99a380f3-fa34-450f-89f7-dc698e04379d tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1210 microversion: 2.1 time: 0.314749 Aug 02 21:50:16.392984 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 453/934] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:16 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1210 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:17.383385 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-13d0c65a-ae38-4086-b002-91eb4ff468f3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:17.384021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-13d0c65a-ae38-4086-b002-91eb4ff468f3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:17.393026 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13d0c65a-ae38-4086-b002-91eb4ff468f3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:17.393786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13d0c65a-ae38-4086-b002-91eb4ff468f3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:17.395308 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13d0c65a-ae38-4086-b002-91eb4ff468f3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:17.397521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-13d0c65a-ae38-4086-b002-91eb4ff468f3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:17.414137 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0896a79c-ce7f-4e73-94f2-0ffca930f4b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:17.414996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0896a79c-ce7f-4e73-94f2-0ffca930f4b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:17.422462 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0896a79c-ce7f-4e73-94f2-0ffca930f4b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:17.434248 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0896a79c-ce7f-4e73-94f2-0ffca930f4b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:17.436964 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0896a79c-ce7f-4e73-94f2-0ffca930f4b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:17.437633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0896a79c-ce7f-4e73-94f2-0ffca930f4b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:17.536900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0896a79c-ce7f-4e73-94f2-0ffca930f4b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:17.545462 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0896a79c-ce7f-4e73-94f2-0ffca930f4b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1210 microversion: 2.1 time: 0.135259 Aug 02 21:50:17.546046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 454/935] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:17 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1210 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:17.688117 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-13d0c65a-ae38-4086-b002-91eb4ff468f3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:17.696570 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-13d0c65a-ae38-4086-b002-91eb4ff468f3 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1672 microversion: 2.1 time: 0.317457 Aug 02 21:50:17.697901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 482/936] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:17 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1672 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:17.712165 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 21:50:17.712477 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Tue Aug 2 21:50:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 21:50:18.171316 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-887c2804-b58a-4a6f-969c-9e14e3d1b865 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:18.171582 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-887c2804-b58a-4a6f-969c-9e14e3d1b865 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:18.183987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-887c2804-b58a-4a6f-969c-9e14e3d1b865 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:18.184488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-887c2804-b58a-4a6f-969c-9e14e3d1b865 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:18.185819 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-887c2804-b58a-4a6f-969c-9e14e3d1b865 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:18.186269 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-887c2804-b58a-4a6f-969c-9e14e3d1b865 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:18.249298 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-887c2804-b58a-4a6f-969c-9e14e3d1b865 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/ips" status: 200 len: 151 microversion: 2.1 time: 0.081897 Aug 02 21:50:18.250502 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 455/937] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:50:18 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/ips => generated 151 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:18.569351 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f0fe1981-a53d-4c69-a9cf-f7ae10cbc8e1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:18.569916 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f0fe1981-a53d-4c69-a9cf-f7ae10cbc8e1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:18.588103 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f0fe1981-a53d-4c69-a9cf-f7ae10cbc8e1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:18.588869 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f0fe1981-a53d-4c69-a9cf-f7ae10cbc8e1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:18.589926 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f0fe1981-a53d-4c69-a9cf-f7ae10cbc8e1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:18.590463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f0fe1981-a53d-4c69-a9cf-f7ae10cbc8e1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:18.721316 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-600eacdc-5ba0-4263-82fa-aebdeec19d3e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:18.722129 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-600eacdc-5ba0-4263-82fa-aebdeec19d3e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:18.733531 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-600eacdc-5ba0-4263-82fa-aebdeec19d3e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:18.735259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-600eacdc-5ba0-4263-82fa-aebdeec19d3e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:18.753189 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-600eacdc-5ba0-4263-82fa-aebdeec19d3e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:18.753724 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-600eacdc-5ba0-4263-82fa-aebdeec19d3e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:18.997217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f0fe1981-a53d-4c69-a9cf-f7ae10cbc8e1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:19.008526 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f0fe1981-a53d-4c69-a9cf-f7ae10cbc8e1 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.442810 Aug 02 21:50:19.024811 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 483/938] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:18 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:19.030213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-49e21773-52e8-45a4-91c9-2e4bd0fabc15 req-1167f4cc-6a9a-408f-bc5a-c7b380f6b5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49a1721-ee1f-4401-abbf-ce8fa780dbfe", "name": "network-vif-deleted", "tag": "23f3af35-5b76-4520-a7da-3babbb77df62"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:19.040223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-49e21773-52e8-45a4-91c9-2e4bd0fabc15 req-1167f4cc-6a9a-408f-bc5a-c7b380f6b5e7 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:19.040858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-49e21773-52e8-45a4-91c9-2e4bd0fabc15 req-1167f4cc-6a9a-408f-bc5a-c7b380f6b5e7 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:19.042563 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-600eacdc-5ba0-4263-82fa-aebdeec19d3e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d13a56d271447bb936cea12e693b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c98a5a02318476daf8318190d7e1a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:19.051450 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-600eacdc-5ba0-4263-82fa-aebdeec19d3e tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 200 len: 1605 microversion: 2.1 time: 0.336796 Aug 02 21:50:19.052590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 456/939] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:18 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 1605 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:19.054328 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-49e21773-52e8-45a4-91c9-2e4bd0fabc15 req-1167f4cc-6a9a-408f-bc5a-c7b380f6b5e7 service nova] Creating event network-vif-deleted:23f3af35-5b76-4520-a7da-3babbb77df62 for instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe on hv-cinder-85144 Aug 02 21:50:19.060714 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-49e21773-52e8-45a4-91c9-2e4bd0fabc15 req-1167f4cc-6a9a-408f-bc5a-c7b380f6b5e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 Aug 02 21:50:19.061851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 484/940] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:19.793872 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-aab2382b-4d55-43cc-895d-2f143933c960 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4708585b-b9c5-4d52-a839-22e0171fa5b4"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:19.811101 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-aab2382b-4d55-43cc-895d-2f143933c960 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:19.818389 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aab2382b-4d55-43cc-895d-2f143933c960 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:19.819125 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aab2382b-4d55-43cc-895d-2f143933c960 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:19.820319 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aab2382b-4d55-43cc-895d-2f143933c960 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:19.821091 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-aab2382b-4d55-43cc-895d-2f143933c960 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:19.866992 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-1cac5ff1-72c5-48d5-9818-3d3f0de142f6 req-071e1ec6-034f-4ba7-b98d-f5576d09178d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834de2b6-db09-4c6d-bd2d-4642f520cb3b", "tag": "fda0d1b6-b89a-490d-9981-2e3fa33efca2"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:19.880593 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-1cac5ff1-72c5-48d5-9818-3d3f0de142f6 req-071e1ec6-034f-4ba7-b98d-f5576d09178d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:19.886947 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-1cac5ff1-72c5-48d5-9818-3d3f0de142f6 req-071e1ec6-034f-4ba7-b98d-f5576d09178d service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:19.905120 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-1cac5ff1-72c5-48d5-9818-3d3f0de142f6 req-071e1ec6-034f-4ba7-b98d-f5576d09178d service nova] Creating event network-changed:fda0d1b6-b89a-490d-9981-2e3fa33efca2 for instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b on hv-cinder-85144 Aug 02 21:50:19.911440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-1cac5ff1-72c5-48d5-9818-3d3f0de142f6 req-071e1ec6-034f-4ba7-b98d-f5576d09178d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048955 Aug 02 21:50:19.913000 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 485/941] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:50:20.025542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:20.031494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7c1bb441-48a5-463a-8439-6412ef5f15f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:20.032471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7c1bb441-48a5-463a-8439-6412ef5f15f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:20.043047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7c1bb441-48a5-463a-8439-6412ef5f15f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:20.043521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7c1bb441-48a5-463a-8439-6412ef5f15f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:20.056712 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7c1bb441-48a5-463a-8439-6412ef5f15f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:20.057014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7c1bb441-48a5-463a-8439-6412ef5f15f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:20.219509 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-aab2382b-4d55-43cc-895d-2f143933c960 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "POST /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429534 Aug 02 21:50:20.227380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 457/942] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:50:19 2022] POST /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:20.235657 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:20.236693 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:20.250461 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:20.250982 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:20.251848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:20.252526 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:20.274930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] HTTP exception thrown: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Request method failure captured: Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe HTTP/1.1 Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm4PJks9DGp_XsP_qbfZ7_XzDTbGiSaM3ICbo1GgA-9nAF2EphKBkxxKUY8V_ADFW2rWQ_y5i7RnWLM1ArDOD1LoHgm5ObhxQow_8cnehSD3JYihs-PXo2YYaCbYYss-qMyiy2J6CWMUeYce2GTo0Ukeacn3MXFNQl5zjO6mPJ8UD8 Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:20.277200 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 3d13a56d271447bb936cea12e693b22f Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:20.279343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'f49a1721-ee1f-4401-abbf-ce8fa780dbfe'} Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:20.280272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:20.282062 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:20.283346 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Returning 404 to user: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:20.283346 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0f8b0cf9-90aa-41d7-8240-5af9d00ec696 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 404 len: 111 microversion: 2.1 time: 0.051860 Aug 02 21:50:20.283346 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 458/943] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:20 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:20.301955 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2df205f9-83df-4f01-8efb-bd8f72fd1964 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '.version_select at 0x7ff552eca0d0>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:20.350431 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2df205f9-83df-4f01-8efb-bd8f72fd1964 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086784269" status: 202 len: 0 microversion: 2.1 time: 0.059529 Aug 02 21:50:20.351377 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 459/944] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 2 21:50:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086784269 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:50:20.651963 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-7c1bb441-48a5-463a-8439-6412ef5f15f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:20.659632 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7c1bb441-48a5-463a-8439-6412ef5f15f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.632429 Aug 02 21:50:20.660322 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 486/945] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:20 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:21.681719 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-453efec5-4b5f-451c-b7da-cba39eea91d9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:21.682593 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-453efec5-4b5f-451c-b7da-cba39eea91d9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:21.689782 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-453efec5-4b5f-451c-b7da-cba39eea91d9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:21.690370 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-453efec5-4b5f-451c-b7da-cba39eea91d9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:21.691276 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-453efec5-4b5f-451c-b7da-cba39eea91d9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:21.691820 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-453efec5-4b5f-451c-b7da-cba39eea91d9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:22.038305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-453efec5-4b5f-451c-b7da-cba39eea91d9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:22.046415 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-453efec5-4b5f-451c-b7da-cba39eea91d9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.369192 Aug 02 21:50:22.047305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 460/946] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:21 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:23.067314 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ee64032c-fa6a-4bc9-aa68-1015dea36eba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:23.067896 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ee64032c-fa6a-4bc9-aa68-1015dea36eba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:23.074913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ee64032c-fa6a-4bc9-aa68-1015dea36eba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:23.075364 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ee64032c-fa6a-4bc9-aa68-1015dea36eba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:23.076238 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ee64032c-fa6a-4bc9-aa68-1015dea36eba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:23.076679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ee64032c-fa6a-4bc9-aa68-1015dea36eba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:23.238310 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ee64032c-fa6a-4bc9-aa68-1015dea36eba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:23.246418 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ee64032c-fa6a-4bc9-aa68-1015dea36eba tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.182968 Aug 02 21:50:23.246990 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 487/947] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:23 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:23.623923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:23.624468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:23.627009 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:23.627679 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=6 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:23.634156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:23.634859 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:23.635790 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:23.636267 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:23.652859 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] HTTP exception thrown: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Request method failure captured: Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe HTTP/1.1 Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm4PJks9DGp_XsP_qbfZ7_XzDTbGiSaM3ICbo1GgA-9nAF2EphKBkxxKUY8V_ADFW2rWQ_y5i7RnWLM1ArDOD1LoHgm5ObhxQow_8cnehSD3JYihs-PXo2YYaCbYYss-qMyiy2J6CWMUeYce2GTo0Ukeacn3MXFNQl5zjO6mPJ8UD8 Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:23.655489 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 3d13a56d271447bb936cea12e693b22f Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.657221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'f49a1721-ee1f-4401-abbf-ce8fa780dbfe'} Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:23.658380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.659771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.662139 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Returning 404 to user: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:23.663005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-44db9e15-ba85-4749-80fd-69a71a05fa1d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 404 len: 111 microversion: 2.1 time: 0.043374 Aug 02 21:50:23.663573 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 461/948] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:23 2022] DELETE /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:23.671625 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:23.672296 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: f49a1721-ee1f-4401-abbf-ce8fa780dbfe] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:23.678305 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:23.678756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:23.679525 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:23.679962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:23.697767 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] HTTP exception thrown: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Request method failure captured: Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe HTTP/1.1 Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm4PJks9DGp_XsP_qbfZ7_XzDTbGiSaM3ICbo1GgA-9nAF2EphKBkxxKUY8V_ADFW2rWQ_y5i7RnWLM1ArDOD1LoHgm5ObhxQow_8cnehSD3JYihs-PXo2YYaCbYYss-qMyiy2J6CWMUeYce2GTo0Ukeacn3MXFNQl5zjO6mPJ8UD8 Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:23.699411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 3d13a56d271447bb936cea12e693b22f Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.701371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'f49a1721-ee1f-4401-abbf-ce8fa780dbfe'} Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:23.702289 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. Aug 02 21:50:23.703782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:23.705128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Returning 404 to user: Instance f49a1721-ee1f-4401-abbf-ce8fa780dbfe could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:23.705128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6a4d90d7-1c5b-4129-a11d-6549ba713f5d tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe" status: 404 len: 111 microversion: 2.1 time: 0.035825 Aug 02 21:50:23.705128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 488/949] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:23 2022] GET /compute/v2.1/servers/f49a1721-ee1f-4401-abbf-ce8fa780dbfe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:24.267543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-37ae0706-4899-4010-b9be-f6c780be3425 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:24.268220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-37ae0706-4899-4010-b9be-f6c780be3425 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:24.275104 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-37ae0706-4899-4010-b9be-f6c780be3425 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:24.275803 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-37ae0706-4899-4010-b9be-f6c780be3425 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:24.276626 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-37ae0706-4899-4010-b9be-f6c780be3425 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:24.277083 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-37ae0706-4899-4010-b9be-f6c780be3425 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:24.418565 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-37ae0706-4899-4010-b9be-f6c780be3425 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:24.426688 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-37ae0706-4899-4010-b9be-f6c780be3425 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.163586 Aug 02 21:50:24.427408 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 462/950] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:24 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:24.858003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:24.858566 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:24.860545 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:24.866710 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:24.867158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:24.867946 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:24.868409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:24.883543 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] HTTP exception thrown: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Request method failure captured: Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: DELETE /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d HTTP/1.1 Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm4PJks9DGp_XsP_qbfZ7_XzDTbGiSaM3ICbo1GgA-9nAF2EphKBkxxKUY8V_ADFW2rWQ_y5i7RnWLM1ArDOD1LoHgm5ObhxQow_8cnehSD3JYihs-PXo2YYaCbYYss-qMyiy2J6CWMUeYce2GTo0Ukeacn3MXFNQl5zjO6mPJ8UD8 Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:24.885132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 3d13a56d271447bb936cea12e693b22f Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.886676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '29658748-1966-42f3-9fec-c72df8ee883d'} Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:24.891217 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.892729 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.894204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Returning 404 to user: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:24.894204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7c70739c-0df9-403b-abd5-338f21817898 tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "DELETE /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 404 len: 111 microversion: 2.1 time: 0.032635 Aug 02 21:50:24.894204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 489/951] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:24 2022] DELETE /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:24.896048 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:24.896717 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] [instance: 29658748-1966-42f3-9fec-c72df8ee883d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:24.903548 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:24.904059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:24.904886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:24.905328 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:24.919993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] HTTP exception thrown: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Request method failure captured: Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d HTTP/1.1 Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm4PJks9DGp_XsP_qbfZ7_XzDTbGiSaM3ICbo1GgA-9nAF2EphKBkxxKUY8V_ADFW2rWQ_y5i7RnWLM1ArDOD1LoHgm5ObhxQow_8cnehSD3JYihs-PXo2YYaCbYYss-qMyiy2J6CWMUeYce2GTo0Ukeacn3MXFNQl5zjO6mPJ8UD8 Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:24.921728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c98a5a02318476daf8318190d7e1a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 6c98a5a02318476daf8318190d7e1a76 Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628314836 Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 3d13a56d271447bb936cea12e693b22f Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeTestJSON-628314836-project Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.923273 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '29658748-1966-42f3-9fec-c72df8ee883d'} Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:24.924063 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. Aug 02 21:50:24.925768 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:24.927017 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] Returning 404 to user: Instance 29658748-1966-42f3-9fec-c72df8ee883d could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:24.927017 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4df0d3e5-d2af-4ff9-acdf-2dacf139a4cb tempest-AttachVolumeTestJSON-628314836 tempest-AttachVolumeTestJSON-628314836-project] 10.222.0.57 "GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d" status: 404 len: 111 microversion: 2.1 time: 0.031278 Aug 02 21:50:24.927017 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 463/952] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:24 2022] GET /compute/v2.1/servers/29658748-1966-42f3-9fec-c72df8ee883d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 21:50:25.448784 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e5d6991f-0af7-4c4f-8890-b7dfe824115e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:25.449411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e5d6991f-0af7-4c4f-8890-b7dfe824115e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:25.455442 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e5d6991f-0af7-4c4f-8890-b7dfe824115e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:25.456026 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e5d6991f-0af7-4c4f-8890-b7dfe824115e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:25.456856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e5d6991f-0af7-4c4f-8890-b7dfe824115e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:25.457298 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e5d6991f-0af7-4c4f-8890-b7dfe824115e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:25.585544 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e5d6991f-0af7-4c4f-8890-b7dfe824115e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:25.593627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e5d6991f-0af7-4c4f-8890-b7dfe824115e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.148720 Aug 02 21:50:25.607597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 490/953] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:25 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:26.614949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-acecaf54-38d6-4fa2-a8ce-650e76e8d169 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:26.615569 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-acecaf54-38d6-4fa2-a8ce-650e76e8d169 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:26.622103 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-acecaf54-38d6-4fa2-a8ce-650e76e8d169 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:26.622563 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-acecaf54-38d6-4fa2-a8ce-650e76e8d169 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:26.623409 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-acecaf54-38d6-4fa2-a8ce-650e76e8d169 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:26.623856 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-acecaf54-38d6-4fa2-a8ce-650e76e8d169 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:26.884164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-acecaf54-38d6-4fa2-a8ce-650e76e8d169 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:26.898453 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-acecaf54-38d6-4fa2-a8ce-650e76e8d169 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.287329 Aug 02 21:50:26.899377 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 464/954] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:26 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:27.919478 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e3a94986-e844-448a-b4e2-863fdcb0fb6e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:27.920209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e3a94986-e844-448a-b4e2-863fdcb0fb6e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:27.926974 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e3a94986-e844-448a-b4e2-863fdcb0fb6e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:27.927956 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e3a94986-e844-448a-b4e2-863fdcb0fb6e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:27.929008 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e3a94986-e844-448a-b4e2-863fdcb0fb6e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:27.929543 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e3a94986-e844-448a-b4e2-863fdcb0fb6e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:28.159063 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e3a94986-e844-448a-b4e2-863fdcb0fb6e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:28.167491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e3a94986-e844-448a-b4e2-863fdcb0fb6e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.252310 Aug 02 21:50:28.168157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 491/955] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:27 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:29.189041 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-af08796b-6abb-4409-9c24-8e187199f959 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:29.189692 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-af08796b-6abb-4409-9c24-8e187199f959 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:29.196350 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-af08796b-6abb-4409-9c24-8e187199f959 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:29.196805 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-af08796b-6abb-4409-9c24-8e187199f959 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:29.197584 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-af08796b-6abb-4409-9c24-8e187199f959 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:29.198018 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-af08796b-6abb-4409-9c24-8e187199f959 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:29.337840 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-af08796b-6abb-4409-9c24-8e187199f959 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:29.345530 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-af08796b-6abb-4409-9c24-8e187199f959 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.160435 Aug 02 21:50:29.346527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 465/956] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:29 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:30.066856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2892b6cd-beb1-4844-8a9b-ecdd22fc27bd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:30.067404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2892b6cd-beb1-4844-8a9b-ecdd22fc27bd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:30.074023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2892b6cd-beb1-4844-8a9b-ecdd22fc27bd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:30.074562 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2892b6cd-beb1-4844-8a9b-ecdd22fc27bd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:30.075356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2892b6cd-beb1-4844-8a9b-ecdd22fc27bd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:30.075874 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2892b6cd-beb1-4844-8a9b-ecdd22fc27bd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:30.090221 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:30.161935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-2892b6cd-beb1-4844-8a9b-ecdd22fc27bd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lazy-loading 'services' on Instance uuid 01042a8e-a479-4f1d-9239-6fb722bcd33d {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:50:30.241776 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2892b6cd-beb1-4844-8a9b-ecdd22fc27bd tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-volume_attachments/4708585b-b9c5-4d52-a839-22e0171fa5b4" status: 202 len: 0 microversion: 2.1 time: 0.178812 Aug 02 21:50:30.242361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 492/957] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:50:30 2022] DELETE /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-volume_attachments/4708585b-b9c5-4d52-a839-22e0171fa5b4 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:50:30.251087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6e760e6c-0070-42fb-b261-27ba30787be8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:30.253858 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6e760e6c-0070-42fb-b261-27ba30787be8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:30.260089 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6e760e6c-0070-42fb-b261-27ba30787be8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:30.260562 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6e760e6c-0070-42fb-b261-27ba30787be8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:30.261505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6e760e6c-0070-42fb-b261-27ba30787be8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:30.261944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6e760e6c-0070-42fb-b261-27ba30787be8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:30.294055 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6e760e6c-0070-42fb-b261-27ba30787be8 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Aug 02 21:50:30.295233 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 466/958] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:50:30 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:30.366324 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ed993de5-d3d0-4d8a-be86-c912024f15f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:30.367119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ed993de5-d3d0-4d8a-be86-c912024f15f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:30.373505 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ed993de5-d3d0-4d8a-be86-c912024f15f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:30.373957 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ed993de5-d3d0-4d8a-be86-c912024f15f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:30.374726 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ed993de5-d3d0-4d8a-be86-c912024f15f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:30.375163 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ed993de5-d3d0-4d8a-be86-c912024f15f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:30.518582 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ed993de5-d3d0-4d8a-be86-c912024f15f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:30.526422 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ed993de5-d3d0-4d8a-be86-c912024f15f3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.164218 Aug 02 21:50:30.527175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 493/959] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:30 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:31.306937 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1704a1e1-8295-4a09-9c01-469a4e4df9c0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:31.309391 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1704a1e1-8295-4a09-9c01-469a4e4df9c0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:31.316675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1704a1e1-8295-4a09-9c01-469a4e4df9c0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:31.317319 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1704a1e1-8295-4a09-9c01-469a4e4df9c0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:31.317949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1704a1e1-8295-4a09-9c01-469a4e4df9c0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:31.318509 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1704a1e1-8295-4a09-9c01-469a4e4df9c0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:31.349527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1704a1e1-8295-4a09-9c01-469a4e4df9c0 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046502 Aug 02 21:50:31.350090 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 467/960] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:50:31 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:50:31.413213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-27b48fd9-80c8-43d4-98e5-a9700a5ec5ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:31.413760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-27b48fd9-80c8-43d4-98e5-a9700a5ec5ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:31.420293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-27b48fd9-80c8-43d4-98e5-a9700a5ec5ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:31.420788 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-27b48fd9-80c8-43d4-98e5-a9700a5ec5ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:31.421578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-27b48fd9-80c8-43d4-98e5-a9700a5ec5ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:31.422023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-27b48fd9-80c8-43d4-98e5-a9700a5ec5ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:31.447334 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-27b48fd9-80c8-43d4-98e5-a9700a5ec5ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:50:31.530477 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-27b48fd9-80c8-43d4-98e5-a9700a5ec5ca tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 204 len: 0 microversion: 2.1 time: 0.120930 Aug 02 21:50:31.531054 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 494/961] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:31 2022] DELETE /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:50:31.539918 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a841e590-e611-4e7c-9a17-652311fe4a2b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:31.540601 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a841e590-e611-4e7c-9a17-652311fe4a2b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:31.547043 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a841e590-e611-4e7c-9a17-652311fe4a2b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:31.547642 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a841e590-e611-4e7c-9a17-652311fe4a2b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:31.548621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a841e590-e611-4e7c-9a17-652311fe4a2b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:31.549209 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-a841e590-e611-4e7c-9a17-652311fe4a2b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:31.550228 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b2c025f0-8e31-42d0-bb35-7e5e6b295ce9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:31.551265 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b2c025f0-8e31-42d0-bb35-7e5e6b295ce9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:31.558638 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b2c025f0-8e31-42d0-bb35-7e5e6b295ce9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:31.559204 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b2c025f0-8e31-42d0-bb35-7e5e6b295ce9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:31.560598 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b2c025f0-8e31-42d0-bb35-7e5e6b295ce9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:31.561120 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b2c025f0-8e31-42d0-bb35-7e5e6b295ce9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:31.702985 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a841e590-e611-4e7c-9a17-652311fe4a2b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:31.711051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a841e590-e611-4e7c-9a17-652311fe4a2b tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1683 microversion: 2.1 time: 0.175615 Aug 02 21:50:31.711706 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 468/962] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:31 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:31.724059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b2c025f0-8e31-42d0-bb35-7e5e6b295ce9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:31.733650 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b2c025f0-8e31-42d0-bb35-7e5e6b295ce9 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.188832 Aug 02 21:50:31.743083 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 495/963] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:31 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:32.733462 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-0440107f-b2df-46b1-add2-72914766df42 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:32.734214 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-0440107f-b2df-46b1-add2-72914766df42 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:32.740756 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0440107f-b2df-46b1-add2-72914766df42 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:32.741203 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0440107f-b2df-46b1-add2-72914766df42 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:32.741968 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0440107f-b2df-46b1-add2-72914766df42 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:32.742405 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-0440107f-b2df-46b1-add2-72914766df42 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:32.755216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-49032727-379a-4d14-8fe7-9d0743d6996a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:32.755836 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-49032727-379a-4d14-8fe7-9d0743d6996a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:32.762368 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-49032727-379a-4d14-8fe7-9d0743d6996a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:32.762824 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-49032727-379a-4d14-8fe7-9d0743d6996a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:32.763860 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-49032727-379a-4d14-8fe7-9d0743d6996a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:32.764331 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-49032727-379a-4d14-8fe7-9d0743d6996a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:32.882923 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-0440107f-b2df-46b1-add2-72914766df42 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:32.891035 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-0440107f-b2df-46b1-add2-72914766df42 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1683 microversion: 2.1 time: 0.161905 Aug 02 21:50:32.891861 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 469/964] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:32 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:32.915195 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-49032727-379a-4d14-8fe7-9d0743d6996a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:32.923715 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-49032727-379a-4d14-8fe7-9d0743d6996a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.172781 Aug 02 21:50:32.924418 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 496/965] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:32 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:33.204216 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-594ae5ee-777a-4169-b623-a59056d13b35 req-772a29c5-19be-4c4a-ba6b-6837e72e6d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834de2b6-db09-4c6d-bd2d-4642f520cb3b", "name": "network-vif-plugged", "status": "completed", "tag": "fda0d1b6-b89a-490d-9981-2e3fa33efca2"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:33.214205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-594ae5ee-777a-4169-b623-a59056d13b35 req-772a29c5-19be-4c4a-ba6b-6837e72e6d12 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:33.215046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-594ae5ee-777a-4169-b623-a59056d13b35 req-772a29c5-19be-4c4a-ba6b-6837e72e6d12 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:33.237985 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-594ae5ee-777a-4169-b623-a59056d13b35 req-772a29c5-19be-4c4a-ba6b-6837e72e6d12 service nova] Creating event network-vif-plugged:fda0d1b6-b89a-490d-9981-2e3fa33efca2 for instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b on hv-cinder-85144 Aug 02 21:50:33.245311 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-594ae5ee-777a-4169-b623-a59056d13b35 req-772a29c5-19be-4c4a-ba6b-6837e72e6d12 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044709 Aug 02 21:50:33.246090 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 470/966] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:33.913183 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2aba6fdd-102e-40d8-9d45-1d37de075c32 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:33.913804 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2aba6fdd-102e-40d8-9d45-1d37de075c32 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:33.920676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2aba6fdd-102e-40d8-9d45-1d37de075c32 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:33.921354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2aba6fdd-102e-40d8-9d45-1d37de075c32 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:33.922143 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2aba6fdd-102e-40d8-9d45-1d37de075c32 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:33.922735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2aba6fdd-102e-40d8-9d45-1d37de075c32 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:33.949448 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2950652d-b6db-4c83-91ce-1ccf9c6c2fd2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:33.951002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2950652d-b6db-4c83-91ce-1ccf9c6c2fd2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:33.960851 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2950652d-b6db-4c83-91ce-1ccf9c6c2fd2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:33.961332 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2950652d-b6db-4c83-91ce-1ccf9c6c2fd2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:33.962092 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2950652d-b6db-4c83-91ce-1ccf9c6c2fd2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:33.962554 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2950652d-b6db-4c83-91ce-1ccf9c6c2fd2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:34.113447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2aba6fdd-102e-40d8-9d45-1d37de075c32 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:34.123528 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2aba6fdd-102e-40d8-9d45-1d37de075c32 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1683 microversion: 2.1 time: 0.212990 Aug 02 21:50:34.123789 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 497/967] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:33 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:34.190282 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2950652d-b6db-4c83-91ce-1ccf9c6c2fd2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:34.198368 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2950652d-b6db-4c83-91ce-1ccf9c6c2fd2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.256015 Aug 02 21:50:34.199144 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 471/968] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:33 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:34.669462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-03e4c541-4454-47ed-b5f8-4f8acbbe7495 req-e23fe38f-4f7d-40a1-bf96-87bb89bf71af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01042a8e-a479-4f1d-9239-6fb722bcd33d", "name": "network-vif-deleted", "tag": "d1f41ccf-c167-413e-a0fd-a61749acbead"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:34.675962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:34.680200 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-03e4c541-4454-47ed-b5f8-4f8acbbe7495 req-e23fe38f-4f7d-40a1-bf96-87bb89bf71af service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:34.680869 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-03e4c541-4454-47ed-b5f8-4f8acbbe7495 req-e23fe38f-4f7d-40a1-bf96-87bb89bf71af service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:34.693421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-03e4c541-4454-47ed-b5f8-4f8acbbe7495 req-e23fe38f-4f7d-40a1-bf96-87bb89bf71af service nova] Creating event network-vif-deleted:d1f41ccf-c167-413e-a0fd-a61749acbead for instance 01042a8e-a479-4f1d-9239-6fb722bcd33d on hv-cinder-85144 Aug 02 21:50:34.698835 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-03e4c541-4454-47ed-b5f8-4f8acbbe7495 req-e23fe38f-4f7d-40a1-bf96-87bb89bf71af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033263 Aug 02 21:50:34.699803 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 498/969] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:35.154801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:35.155414 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:35.158235 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:35.166178 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:35.167161 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:35.167956 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:35.168420 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:35.221621 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e5fcaca7-ffe6-4879-a2d1-953de6fad8a3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:35.222335 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e5fcaca7-ffe6-4879-a2d1-953de6fad8a3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:35.223861 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:35.224448 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:35.224995 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lazy-loading 'fault' on Instance uuid 01042a8e-a479-4f1d-9239-6fb722bcd33d {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:50:35.230433 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e5fcaca7-ffe6-4879-a2d1-953de6fad8a3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:35.230900 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e5fcaca7-ffe6-4879-a2d1-953de6fad8a3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:35.231688 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e5fcaca7-ffe6-4879-a2d1-953de6fad8a3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:35.232210 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e5fcaca7-ffe6-4879-a2d1-953de6fad8a3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:35.270168 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e477f5953a534355b29c071086846ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63bab062a6e4225a462ac0265535d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:35.278559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-66616bf6-ada7-4356-a194-84590a9b8e27 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 200 len: 1331 microversion: 2.1 time: 0.127638 Aug 02 21:50:35.280717 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 472/970] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:35 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:35.388909 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e5fcaca7-ffe6-4879-a2d1-953de6fad8a3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:35.397672 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e5fcaca7-ffe6-4879-a2d1-953de6fad8a3 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1265 microversion: 2.1 time: 0.181334 Aug 02 21:50:35.398242 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 499/971] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:35 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:50:36.301272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:36.301892 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:36.308288 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:36.308739 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:36.310934 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:36.311372 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:36.325355 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d HTTP/1.1 Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:36.327058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:36.328685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '01042a8e-a479-4f1d-9239-6fb722bcd33d'} Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:36.329538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:36.330870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:36.332050 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:36.332050 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ca7ec581-3cfc-4737-9400-76b1157a83d7 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 404 len: 111 microversion: 2.1 time: 0.031022 Aug 02 21:50:36.332050 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 473/972] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:36 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:36.337095 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1c1ec60d-1a31-4d8b-a2e1-406efa139dd3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '.version_select at 0x7ff55b812ca0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:36.358804 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1c1ec60d-1a31-4d8b-a2e1-406efa139dd3 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772885549" status: 202 len: 0 microversion: 2.1 time: 0.025325 Aug 02 21:50:36.359382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 500/973] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 2 21:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772885549 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:50:36.419609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7c8b6fde-ca75-4728-a714-0c5e40b6a57b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:36.420386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7c8b6fde-ca75-4728-a714-0c5e40b6a57b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:36.426664 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7c8b6fde-ca75-4728-a714-0c5e40b6a57b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:36.427364 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7c8b6fde-ca75-4728-a714-0c5e40b6a57b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:36.428342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7c8b6fde-ca75-4728-a714-0c5e40b6a57b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:36.428939 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7c8b6fde-ca75-4728-a714-0c5e40b6a57b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:36.599530 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7c8b6fde-ca75-4728-a714-0c5e40b6a57b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:36.610295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7c8b6fde-ca75-4728-a714-0c5e40b6a57b tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1453 microversion: 2.1 time: 0.195302 Aug 02 21:50:36.611436 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 474/974] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:36 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:36.632976 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c6fe37c5-1c81-4a69-97e9-9062d7d17e70 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:36.634519 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c6fe37c5-1c81-4a69-97e9-9062d7d17e70 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:36.642078 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6fe37c5-1c81-4a69-97e9-9062d7d17e70 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:36.642764 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6fe37c5-1c81-4a69-97e9-9062d7d17e70 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:36.643709 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6fe37c5-1c81-4a69-97e9-9062d7d17e70 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:36.644280 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c6fe37c5-1c81-4a69-97e9-9062d7d17e70 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:36.865455 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c6fe37c5-1c81-4a69-97e9-9062d7d17e70 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:36.874998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c6fe37c5-1c81-4a69-97e9-9062d7d17e70 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1453 microversion: 2.1 time: 0.246876 Aug 02 21:50:36.876190 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 501/975] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:36 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1453 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:38.297560 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:38.298098 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:38.304866 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:38.305252 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:38.306033 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:38.306464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:38.319676 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: DELETE /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d HTTP/1.1 Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:38.321253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.322848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '01042a8e-a479-4f1d-9239-6fb722bcd33d'} Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:38.323776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.325126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.326501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:38.326501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2ac75448-7d5d-4a79-8a40-eedd5083b325 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 404 len: 111 microversion: 2.1 time: 0.029727 Aug 02 21:50:38.326501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 475/976] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:38 2022] DELETE /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 21:50:38.331272 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:38.331889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 01042a8e-a479-4f1d-9239-6fb722bcd33d] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:38.338471 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:38.338922 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:38.339699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:38.340156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:38.353966 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d HTTP/1.1 Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:38.355633 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.357640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '01042a8e-a479-4f1d-9239-6fb722bcd33d'} Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:38.362440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. Aug 02 21:50:38.364007 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:38.367216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance 01042a8e-a479-4f1d-9239-6fb722bcd33d could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:38.367216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-47deeffc-e88c-406e-a05e-b990c63980f1 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d" status: 404 len: 111 microversion: 2.1 time: 0.029713 Aug 02 21:50:38.367216 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 502/977] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:38 2022] GET /compute/v2.1/servers/01042a8e-a479-4f1d-9239-6fb722bcd33d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:38.994137 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-9b180927-70ce-45b5-bd0f-611baa976ac7 req-9a67db7e-17b8-45a6-874b-1e8df53de0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834de2b6-db09-4c6d-bd2d-4642f520cb3b", "tag": "fda0d1b6-b89a-490d-9981-2e3fa33efca2"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:39.004864 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-9b180927-70ce-45b5-bd0f-611baa976ac7 req-9a67db7e-17b8-45a6-874b-1e8df53de0b7 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.005402 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-9b180927-70ce-45b5-bd0f-611baa976ac7 req-9a67db7e-17b8-45a6-874b-1e8df53de0b7 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.017291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-9b180927-70ce-45b5-bd0f-611baa976ac7 req-9a67db7e-17b8-45a6-874b-1e8df53de0b7 service nova] Creating event network-changed:fda0d1b6-b89a-490d-9981-2e3fa33efca2 for instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b on hv-cinder-85144 Aug 02 21:50:39.024409 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-9b180927-70ce-45b5-bd0f-611baa976ac7 req-9a67db7e-17b8-45a6-874b-1e8df53de0b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033940 Aug 02 21:50:39.024986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 476/978] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:39.508395 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:39.509098 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:39.515462 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.516029 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.516948 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.517507 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.531481 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: DELETE /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 HTTP/1.1 Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:39.533247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.534816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '935f0f24-4d12-498c-bb68-770aa9ee2210'} Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:39.535687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.537137 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.538611 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:39.538611 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b60f5b18-446f-42e0-99c5-351a20006c86 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 404 len: 111 microversion: 2.1 time: 0.033169 Aug 02 21:50:39.539372 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 503/979] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:39 2022] DELETE /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:39.548749 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:39.549539 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: 935f0f24-4d12-498c-bb68-770aa9ee2210] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:39.555783 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.556505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.557281 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.557889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.572247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 HTTP/1.1 Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:39.574061 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.575685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '935f0f24-4d12-498c-bb68-770aa9ee2210'} Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:39.576533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. Aug 02 21:50:39.577699 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.578758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance 935f0f24-4d12-498c-bb68-770aa9ee2210 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:39.578758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-545bb6d2-d15b-403e-b851-54345759c4da tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210" status: 404 len: 111 microversion: 2.1 time: 0.032090 Aug 02 21:50:39.578758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 477/980] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:39 2022] GET /compute/v2.1/servers/935f0f24-4d12-498c-bb68-770aa9ee2210 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:39.584913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:39.585413 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:39.591401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.591789 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.592671 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.593104 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.609850 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: DELETE /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 HTTP/1.1 Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:39.611247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.613014 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'f3a43570-a3a3-44b3-80c6-dc192cc97025'} Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:39.613950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.615393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.618062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:39.618062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0c7ff169-72fb-4c64-9442-56f338a59bf2 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 404 len: 111 microversion: 2.1 time: 0.032449 Aug 02 21:50:39.618062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 504/981] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:39 2022] DELETE /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:39.621343 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:39.621968 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: f3a43570-a3a3-44b3-80c6-dc192cc97025] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:39.628723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.629189 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.630154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:39.630603 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:39.645095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 HTTP/1.1 Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:39.646891 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.648454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'f3a43570-a3a3-44b3-80c6-dc192cc97025'} Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:39.652381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. Aug 02 21:50:39.653804 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:39.654989 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance f3a43570-a3a3-44b3-80c6-dc192cc97025 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:39.654989 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c8c8f26b-989b-4f01-b81c-bf7f2883dc05 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025" status: 404 len: 111 microversion: 2.1 time: 0.030823 Aug 02 21:50:39.654989 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 478/982] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:39 2022] GET /compute/v2.1/servers/f3a43570-a3a3-44b3-80c6-dc192cc97025 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:40.795796 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:40.796466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:40.803181 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:40.803758 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:40.804670 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:40.805213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:40.822667 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: DELETE /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd HTTP/1.1 Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:40.824345 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.825924 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'ffdc7be9-6b66-4157-8533-c7fedcee85cd'} Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:40.826702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.828003 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.829756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:40.829756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-fbb210c5-94f3-4e0c-aba2-158521f25e50 tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 404 len: 111 microversion: 2.1 time: 0.034507 Aug 02 21:50:40.829756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 505/983] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:50:40 2022] DELETE /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:40.834731 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:40.835473 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] [instance: ffdc7be9-6b66-4157-8533-c7fedcee85cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:40.842576 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:40.843034 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:40.843827 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:40.844302 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:40.859222 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] HTTP exception thrown: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Request method failure captured: Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd HTTP/1.1 Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm7rl5sPqqa-TR_LGDEmK_02599XGHo6xJRW6Z288-C1f5kRqP5srM9EIXd2FWO-PmezThDiWjCVzHrz_HyrOVtgRCcmQR20v3dqk3Rki1sFan6i2-lYE88OmfgwiAiDDsNqjxIpQNuG1zxVWR7xhmPAl2qnfH7lFRrfT5KY-EdG1A Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:40.860714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c63bab062a6e4225a462ac0265535d16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c63bab062a6e4225a462ac0265535d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: c63bab062a6e4225a462ac0265535d16 Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718483344 Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: e477f5953a534355b29c071086846ff6 Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeNegativeTest-718483344-project Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.862256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'ffdc7be9-6b66-4157-8533-c7fedcee85cd'} Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:40.863472 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. Aug 02 21:50:40.864962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:40.866510 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] Returning 404 to user: Instance ffdc7be9-6b66-4157-8533-c7fedcee85cd could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:40.866510 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-28080e35-beae-4adb-8803-a8d95cb84c1a tempest-AttachVolumeNegativeTest-718483344 tempest-AttachVolumeNegativeTest-718483344-project] 10.222.0.57 "GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd" status: 404 len: 111 microversion: 2.1 time: 0.031692 Aug 02 21:50:40.866510 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 479/984] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:50:40 2022] GET /compute/v2.1/servers/ffdc7be9-6b66-4157-8533-c7fedcee85cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:46.358880 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c2af53a3-e199-4400-9e62-fe09c0b899b2 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Action: 'create', calling method: .version_select at 0x7ff55b79adc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-353538000", "metadata": {"Type": "work"}}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c2af53a3-e199-4400-9e62-fe09c0b899b2 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Request method failure captured: Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 121 Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zw27jMoQUU0DZL31cfjGJu5K6rQYg6fe3oN9nnuRLe5_nBFhWN7hO02LlEj7tk6NZ43fOjKJzwS8yacDLI2XLFFa7GZTpYmrRFJDg_WJHzpeVkNlIoz5WCqthIxvZawjVM1kGZBuGvewxP70SHryzNo8taxH0ROEUpWVYTMOwFXcq4 Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:46.372059 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 02ef57d67d424be7afec59590c6a5aac Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-353538000", "metadata": {"Type": "work"}}} Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: Aug 02 21:50:46.373720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-353538000', 'metadata': {'Type': 'work'}}}} Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise error Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:46.374893 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 21:50:46.376489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 21:50:46.377981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 21:50:46.377981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.377981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c2af53a3-e199-4400-9e62-fe09c0b899b2 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:46.377981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c2af53a3-e199-4400-9e62-fe09c0b899b2 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134142 Aug 02 21:50:46.377981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 506/985] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 2 21:50:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 21:50:46.384166 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b5b305da-b246-4e3d-abf2-92aafb0bdda6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Action: 'create', calling method: .version_select at 0x7ff552d0c5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1630760069", "metadata": {"Type": "work"}}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b5b305da-b246-4e3d-abf2-92aafb0bdda6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Request method failure captured: Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 120 Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zw27jMoQUU0DZL31cfjGJu5K6rQYg6fe3oN9nnuRLe5_nBFhWN7hO02LlEj7tk6NZ43fOjKJzwS8yacDLI2XLFFa7GZTpYmrRFJDg_WJHzpeVkNlIoz5WCqthIxvZawjVM1kGZBuGvewxP70SHryzNo8taxH0ROEUpWVYTMOwFXcq4 Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:46.388641 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 02ef57d67d424be7afec59590c6a5aac Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1630760069", "metadata": {"Type": "work"}}} Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: Aug 02 21:50:46.390226 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1630760069', 'metadata': {'Type': 'work'}}}} Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise error Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi '0' Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:46.391059 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 21:50:46.392646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 21:50:46.394170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 21:50:46.394170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.394170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b5b305da-b246-4e3d-abf2-92aafb0bdda6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:46.394170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b5b305da-b246-4e3d-abf2-92aafb0bdda6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009793 Aug 02 21:50:46.394170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 480/986] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 2 21:50:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 21:50:46.399803 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7f0e562a-834b-4c54-baab-f3044862ed33 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Action: 'create', calling method: .version_select at 0x7ff55b812b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1025162105", "metadata": {"Type": "work"}}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7f0e562a-834b-4c54-baab-f3044862ed33 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Request method failure captured: Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 119 Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zw27jMoQUU0DZL31cfjGJu5K6rQYg6fe3oN9nnuRLe5_nBFhWN7hO02LlEj7tk6NZ43fOjKJzwS8yacDLI2XLFFa7GZTpYmrRFJDg_WJHzpeVkNlIoz5WCqthIxvZawjVM1kGZBuGvewxP70SHryzNo8taxH0ROEUpWVYTMOwFXcq4 Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:46.404262 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 02ef57d67d424be7afec59590c6a5aac Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1025162105", "metadata": {"Type": "work"}}} Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: Aug 02 21:50:46.405899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1025162105', 'metadata': {'Type': 'work'}}}} Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise error Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi '' Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:46.406816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 21:50:46.408494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 21:50:46.409756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 21:50:46.409756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.409756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7f0e562a-834b-4c54-baab-f3044862ed33 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:46.409756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7f0e562a-834b-4c54-baab-f3044862ed33 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009879 Aug 02 21:50:46.409756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 507/987] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 2 21:50:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 21:50:46.416996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ba52746d-55b9-40be-afce-2a8688be03e6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Calling method '.version_select at 0x7ff552f663a0>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:46.447124 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-ba52746d-55b9-40be-afce-2a8688be03e6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] HTTP exception thrown: Volume tempest-invalid-908243590 could not be found. Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ba52746d-55b9-40be-afce-2a8688be03e6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Request method failure captured: Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-908243590 HTTP/1.1 Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zw27jMoQUU0DZL31cfjGJu5K6rQYg6fe3oN9nnuRLe5_nBFhWN7hO02LlEj7tk6NZ43fOjKJzwS8yacDLI2XLFFa7GZTpYmrRFJDg_WJHzpeVkNlIoz5WCqthIxvZawjVM1kGZBuGvewxP70SHryzNo8taxH0ROEUpWVYTMOwFXcq4 Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:46.449149 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 02ef57d67d424be7afec59590c6a5aac Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Volume tempest-invalid-908243590 could not be found. Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'tempest-invalid-908243590'} Aug 02 21:50:46.450775 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-908243590 could not be found. (HTTP 404) (Request-ID: req-a9cf2515-7fbf-46a7-a1fc-2b2bbf62cd31) Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.451705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 21:50:46.453552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-908243590 could not be found. Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:46.454990 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-908243590 could not be found. Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-908243590 could not be found. Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ba52746d-55b9-40be-afce-2a8688be03e6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Returning 404 to user: Volume tempest-invalid-908243590 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ba52746d-55b9-40be-afce-2a8688be03e6 tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-908243590" status: 404 len: 98 microversion: 2.1 time: 0.039343 Aug 02 21:50:46.456501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 481/988] 10.222.0.57 () {58 vars in 1215 bytes} [Tue Aug 2 21:50:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-908243590 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 21:50:46.462189 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-de6f07ff-1753-4d65-b689-7c704c3cd06e tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003822 Aug 02 21:50:46.462688 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 508/989] 10.222.0.57 () {58 vars in 1140 bytes} [Tue Aug 2 21:50:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 21:50:46.472293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-94e5d93d-9e99-4475-9848-d9841cee180f tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003991 Aug 02 21:50:46.473076 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 482/990] 10.222.0.57 () {58 vars in 1137 bytes} [Tue Aug 2 21:50:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 21:50:46.481659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-994708ce-6a1d-4b76-83ec-b63b10654c2d tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Calling method '.version_select at 0x7ff55b812b80>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:46.510301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-994708ce-6a1d-4b76-83ec-b63b10654c2d tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] HTTP exception thrown: Volume 2a772922-d515-42d4-b1fa-e716b19962dd could not be found. Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-994708ce-6a1d-4b76-83ec-b63b10654c2d tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Request method failure captured: Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: DELETE /compute/v2.1/os-volumes/2a772922-d515-42d4-b1fa-e716b19962dd HTTP/1.1 Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zw27jMoQUU0DZL31cfjGJu5K6rQYg6fe3oN9nnuRLe5_nBFhWN7hO02LlEj7tk6NZ43fOjKJzwS8yacDLI2XLFFa7GZTpYmrRFJDg_WJHzpeVkNlIoz5WCqthIxvZawjVM1kGZBuGvewxP70SHryzNo8taxH0ROEUpWVYTMOwFXcq4 Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:46.512468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 02ef57d67d424be7afec59590c6a5aac Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Volume 2a772922-d515-42d4-b1fa-e716b19962dd could not be found. Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '2a772922-d515-42d4-b1fa-e716b19962dd'} Aug 02 21:50:46.514341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a772922-d515-42d4-b1fa-e716b19962dd could not be found. (HTTP 404) (Request-ID: req-1cbd7463-50b0-4df3-8bb5-3bd7c11f62e7) Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.515349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 21:50:46.516494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a772922-d515-42d4-b1fa-e716b19962dd could not be found. Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 21:50:46.517830 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a772922-d515-42d4-b1fa-e716b19962dd could not be found. Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a772922-d515-42d4-b1fa-e716b19962dd could not be found. Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-994708ce-6a1d-4b76-83ec-b63b10654c2d tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Returning 404 to user: Volume 2a772922-d515-42d4-b1fa-e716b19962dd could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-994708ce-6a1d-4b76-83ec-b63b10654c2d tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/2a772922-d515-42d4-b1fa-e716b19962dd" status: 404 len: 109 microversion: 2.1 time: 0.036289 Aug 02 21:50:46.519586 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 509/991] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 2 21:50:46 2022] DELETE /compute/v2.1/os-volumes/2a772922-d515-42d4-b1fa-e716b19962dd => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 21:50:46.524949 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5958c4a0-e5e2-45c3-97bf-7ba40795da8f tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Calling method '.version_select at 0x7ff552d59160>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:46.553644 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-5958c4a0-e5e2-45c3-97bf-7ba40795da8f tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] HTTP exception thrown: Volume c58c94e2-a4ee-4c33-9f11-81e19018e4d8 could not be found. Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5958c4a0-e5e2-45c3-97bf-7ba40795da8f tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Request method failure captured: Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/os-volumes/c58c94e2-a4ee-4c33-9f11-81e19018e4d8 HTTP/1.1 Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zw27jMoQUU0DZL31cfjGJu5K6rQYg6fe3oN9nnuRLe5_nBFhWN7hO02LlEj7tk6NZ43fOjKJzwS8yacDLI2XLFFa7GZTpYmrRFJDg_WJHzpeVkNlIoz5WCqthIxvZawjVM1kGZBuGvewxP70SHryzNo8taxH0ROEUpWVYTMOwFXcq4 Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:50:46.555770 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/33ab26f968db47a683b1e8e815427ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 33ab26f968db47a683b1e8e815427ce1 Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-VolumesNegativeTest-1039136223 Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 02ef57d67d424be7afec59590c6a5aac Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-VolumesNegativeTest-1039136223-project Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Volume c58c94e2-a4ee-4c33-9f11-81e19018e4d8 could not be found. Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': 'c58c94e2-a4ee-4c33-9f11-81e19018e4d8'} Aug 02 21:50:46.557270 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c58c94e2-a4ee-4c33-9f11-81e19018e4d8 could not be found. (HTTP 404) (Request-ID: req-710eeef8-7280-4d58-bc76-bd75d1991fad) Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.558823 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 21:50:46.560635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c58c94e2-a4ee-4c33-9f11-81e19018e4d8 could not be found. Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 21:50:46.561849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c58c94e2-a4ee-4c33-9f11-81e19018e4d8 could not be found. Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c58c94e2-a4ee-4c33-9f11-81e19018e4d8 could not be found. Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5958c4a0-e5e2-45c3-97bf-7ba40795da8f tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] Returning 404 to user: Volume c58c94e2-a4ee-4c33-9f11-81e19018e4d8 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5958c4a0-e5e2-45c3-97bf-7ba40795da8f tempest-VolumesNegativeTest-1039136223 tempest-VolumesNegativeTest-1039136223-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/c58c94e2-a4ee-4c33-9f11-81e19018e4d8" status: 404 len: 109 microversion: 2.1 time: 0.036577 Aug 02 21:50:46.563243 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 483/992] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 2 21:50:46 2022] GET /compute/v2.1/os-volumes/c58c94e2-a4ee-4c33-9f11-81e19018e4d8 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:50:54.442566 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:54.443422 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:54.447823 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e0e5b9da-5a04-448e-a7c8-e5dd743375e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:54.451235 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e0e5b9da-5a04-448e-a7c8-e5dd743375e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:54.459427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0e5b9da-5a04-448e-a7c8-e5dd743375e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:54.460016 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0e5b9da-5a04-448e-a7c8-e5dd743375e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:54.460825 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0e5b9da-5a04-448e-a7c8-e5dd743375e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:54.461270 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e0e5b9da-5a04-448e-a7c8-e5dd743375e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:54.491875 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e0e5b9da-5a04-448e-a7c8-e5dd743375e7 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050701 Aug 02 21:50:54.492365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 510/993] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 2 21:50:54 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:50:54.552220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=17 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:54.553069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:54.557646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e1275a9b-b175-4584-b9a6-f4860dfc450c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:54.558176 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e1275a9b-b175-4584-b9a6-f4860dfc450c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:54.565372 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e1275a9b-b175-4584-b9a6-f4860dfc450c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:54.565905 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e1275a9b-b175-4584-b9a6-f4860dfc450c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:54.566684 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e1275a9b-b175-4584-b9a6-f4860dfc450c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:54.567121 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e1275a9b-b175-4584-b9a6-f4860dfc450c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:54.593276 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e1275a9b-b175-4584-b9a6-f4860dfc450c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:50:54.678592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e1275a9b-b175-4584-b9a6-f4860dfc450c tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "DELETE /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 204 len: 0 microversion: 2.20 time: 0.127282 Aug 02 21:50:54.679446 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 484/994] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 2 21:50:54 2022] DELETE /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 21:50:54.688624 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:54.689396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:54.695534 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:54.696002 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:54.696852 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:54.697304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:54.830523 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:54.838963 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:54.840562 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:54.842406 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ecdef105-e44d-4272-bbaf-115890f935ce tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.158137 Aug 02 21:50:54.843045 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 511/995] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:50:54 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:50:55.866087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:55.866866 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:55.874138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:55.874666 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:55.875512 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:55.875958 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:56.015786 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:56.024008 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:56.025575 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:56.026741 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3ef66a9b-927c-41ec-b031-09a001422eec tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.165009 Aug 02 21:50:56.027289 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 485/996] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:50:55 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:50:57.050521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:57.051470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:57.058687 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:57.059143 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:57.060670 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:57.061286 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:57.207032 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:57.215407 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:57.217460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e8eced4d8d49458668a52761e9b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522def96635b48a59492fb7083c3c842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:50:57.218693 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9871fbdb-7d85-4db0-ad23-5db2ff032495 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 200 len: 1722 microversion: 2.20 time: 0.172045 Aug 02 21:50:57.219186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 512/997] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:50:57 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 21:50:57.471516 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-db9f2b06-8578-4098-9a06-cc1eabb12ca9 req-8517edf0-2445-4234-914a-bcc01be21d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f0e81e-d7e8-45f4-96c5-08aedf7cc9da", "name": "network-vif-deleted", "tag": "fe08db00-0856-4a99-90d2-bcbf21c1a129"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:50:57.484007 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-db9f2b06-8578-4098-9a06-cc1eabb12ca9 req-8517edf0-2445-4234-914a-bcc01be21d5b service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:57.484964 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-db9f2b06-8578-4098-9a06-cc1eabb12ca9 req-8517edf0-2445-4234-914a-bcc01be21d5b service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:57.505673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-db9f2b06-8578-4098-9a06-cc1eabb12ca9 req-8517edf0-2445-4234-914a-bcc01be21d5b service nova] Creating event network-vif-deleted:fe08db00-0856-4a99-90d2-bcbf21c1a129 for instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da on hv-cinder-85144 Aug 02 21:50:57.511757 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-db9f2b06-8578-4098-9a06-cc1eabb12ca9 req-8517edf0-2445-4234-914a-bcc01be21d5b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044966 Aug 02 21:50:57.513673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 486/998] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:50:58.251963 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:58.251963 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:50:58.255241 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:58.255945 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:58.256858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:50:58.261833 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:50:58.286176 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] HTTP exception thrown: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Request method failure captured: Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da HTTP/1.1 Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm8RIm6h-eMB9LyAlRw7kjb73ENP-MbzEO8CdX1-dfobKkZqwlWSJge7anQuePUEgvnuN2FloeteZxhLFJ90xD5LFdwHzRE9ki5-exGFac6qOePHKDVbY4pUh7Vb-gmvFPUsgV9tTJvjFXZ2ZK_Xi0uR1lkl5aWTP_sPyJBZAUNc2I Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:50:58.287889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_522def96635b48a59492fb7083c3c842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/522def96635b48a59492fb7083c3c842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 57e8eced4d8d49458668a52761e9b8bb Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:50:58.289369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '75f0e81e-d7e8-45f4-96c5-08aedf7cc9da'} Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:50:58.290114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:50:58.291356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:50:58.293509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Returning 404 to user: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:50:58.293509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7aee0d1f-9f84-4678-964a-e8a881b69b20 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 404 len: 111 microversion: 2.20 time: 0.049727 Aug 02 21:50:58.293509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 513/999] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:50:58 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 21:50:58.301958 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a15d544c-3d76-479c-9ae6-9f65e3dabb01 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '.version_select at 0x7ff552f093a0>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:50:58.331820 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a15d544c-3d76-479c-9ae6-9f65e3dabb01 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013692202" status: 204 len: 0 microversion: 2.20 time: 0.034233 Aug 02 21:50:58.332553 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 487/1000] 10.222.0.57 () {60 vars in 1262 bytes} [Tue Aug 2 21:50:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013692202 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 21:51:00.244192 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:00.244701 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:00.252577 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:00.253066 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:00.253846 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:00.254291 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:00.268635 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] HTTP exception thrown: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Request method failure captured: Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: DELETE /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da HTTP/1.1 Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm8RIm6h-eMB9LyAlRw7kjb73ENP-MbzEO8CdX1-dfobKkZqwlWSJge7anQuePUEgvnuN2FloeteZxhLFJ90xD5LFdwHzRE9ki5-exGFac6qOePHKDVbY4pUh7Vb-gmvFPUsgV9tTJvjFXZ2ZK_Xi0uR1lkl5aWTP_sPyJBZAUNc2I Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:51:00.270380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_522def96635b48a59492fb7083c3c842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/522def96635b48a59492fb7083c3c842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 57e8eced4d8d49458668a52761e9b8bb Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.272297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '75f0e81e-d7e8-45f4-96c5-08aedf7cc9da'} Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:51:00.273198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.274619 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.276284 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Returning 404 to user: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:51:00.276284 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9bedd4b9-ecfe-4345-9e09-e6b274fa4289 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "DELETE /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 404 len: 111 microversion: 2.20 time: 0.031673 Aug 02 21:51:00.276284 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 514/1001] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 2 21:51:00 2022] DELETE /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 21:51:00.282167 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:00.282909 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:00.290071 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:00.290529 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:00.291305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:00.291751 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:00.305377 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] HTTP exception thrown: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Request method failure captured: Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da HTTP/1.1 Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm8RIm6h-eMB9LyAlRw7kjb73ENP-MbzEO8CdX1-dfobKkZqwlWSJge7anQuePUEgvnuN2FloeteZxhLFJ90xD5LFdwHzRE9ki5-exGFac6qOePHKDVbY4pUh7Vb-gmvFPUsgV9tTJvjFXZ2ZK_Xi0uR1lkl5aWTP_sPyJBZAUNc2I Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:51:00.307025 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_522def96635b48a59492fb7083c3c842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/522def96635b48a59492fb7083c3c842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 57e8eced4d8d49458668a52761e9b8bb Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.308734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '75f0e81e-d7e8-45f4-96c5-08aedf7cc9da'} Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:51:00.313039 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. Aug 02 21:51:00.314594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:00.315944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Returning 404 to user: Instance 75f0e81e-d7e8-45f4-96c5-08aedf7cc9da could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:51:00.315944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b8aee665-1c92-4ffa-9d96-c6d034224749 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da" status: 404 len: 111 microversion: 2.20 time: 0.030859 Aug 02 21:51:00.315944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 488/1002] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:51:00 2022] GET /compute/v2.1/servers/75f0e81e-d7e8-45f4-96c5-08aedf7cc9da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 21:51:01.453071 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:01.453833 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:01.460063 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:01.460552 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:01.461370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:01.461816 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:01.475081 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] HTTP exception thrown: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Request method failure captured: Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: DELETE /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c HTTP/1.1 Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zm8RIm6h-eMB9LyAlRw7kjb73ENP-MbzEO8CdX1-dfobKkZqwlWSJge7anQuePUEgvnuN2FloeteZxhLFJ90xD5LFdwHzRE9ki5-exGFac6qOePHKDVbY4pUh7Vb-gmvFPUsgV9tTJvjFXZ2ZK_Xi0uR1lkl5aWTP_sPyJBZAUNc2I Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:51:01.476699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_522def96635b48a59492fb7083c3c842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/522def96635b48a59492fb7083c3c842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 57e8eced4d8d49458668a52761e9b8bb Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.479009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '581dd5c7-3160-47ed-ac20-6d35cbd6604c'} Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:51:01.479985 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.481486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.483521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Returning 404 to user: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:51:01.483521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-910d107e-1685-4dc7-a80b-7a2e82bff7b8 tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "DELETE /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 404 len: 111 microversion: 2.20 time: 0.029047 Aug 02 21:51:01.483521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 515/1003] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 2 21:51:01 2022] DELETE /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 21:51:01.487445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:01.488085 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] [instance: 581dd5c7-3160-47ed-ac20-6d35cbd6604c] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:01.494640 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:01.495095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:01.495869 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:01.496349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:01.510728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] HTTP exception thrown: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Request method failure captured: Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c HTTP/1.1 Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zm8RIm6h-eMB9LyAlRw7kjb73ENP-MbzEO8CdX1-dfobKkZqwlWSJge7anQuePUEgvnuN2FloeteZxhLFJ90xD5LFdwHzRE9ki5-exGFac6qOePHKDVbY4pUh7Vb-gmvFPUsgV9tTJvjFXZ2ZK_Xi0uR1lkl5aWTP_sPyJBZAUNc2I Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:51:01.512362 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_522def96635b48a59492fb7083c3c842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/522def96635b48a59492fb7083c3c842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/522def96635b48a59492fb7083c3c842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 522def96635b48a59492fb7083c3c842 Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-886266788 Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 57e8eced4d8d49458668a52761e9b8bb Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-AttachVolumeShelveTestJSON-886266788-project Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.513993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '581dd5c7-3160-47ed-ac20-6d35cbd6604c'} Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:51:01.514907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. Aug 02 21:51:01.516349 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:51:01.517611 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] Returning 404 to user: Instance 581dd5c7-3160-47ed-ac20-6d35cbd6604c could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:51:01.517611 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d0560f19-6d4a-4b14-a83e-58cac4843cca tempest-AttachVolumeShelveTestJSON-886266788 tempest-AttachVolumeShelveTestJSON-886266788-project] 10.222.0.57 "GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c" status: 404 len: 111 microversion: 2.20 time: 0.030396 Aug 02 21:51:01.517611 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 489/1004] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 2 21:51:01 2022] GET /compute/v2.1/servers/581dd5c7-3160-47ed-ac20-6d35cbd6604c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 21:51:53.090552 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1988311532", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "networks": [{"uuid": "646216ff-945f-4723-94c9-5a14e6186faa"}]}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:51:53.100714 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=12 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:53.101388 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=24 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:53.147538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] validate_networks() for [('646216ff-945f-4723-94c9-5a14e6186faa', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:51:53.571122 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:51:53.571557 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:51:53.572043 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:51:53.572489 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:51:53.573178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:51:53.583495 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:53.584098 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:53.585922 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:53.586486 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:53.610096 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Getting quotas for project 3c6e4e1e12db464ba903886b1da734c1. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:51:53.614346 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Getting quotas for user 1e71494efbc64a76bc7d69f9d3bb7b89 and project 3c6e4e1e12db464ba903886b1da734c1. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:51:53.627803 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:51:53.630420 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:51:53.721161 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-981e2df7-12d2-48f0-af87-24207df1ee94 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634669 Aug 02 21:51:53.721815 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 516/1005] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:51:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:51:53.734395 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-19764f30-9982-4894-9486-785540095414 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:53.735069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-19764f30-9982-4894-9486-785540095414 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:53.737190 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:53.737972 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:53.805681 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-19764f30-9982-4894-9486-785540095414 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:51:53.815157 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-19764f30-9982-4894-9486-785540095414 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1214 microversion: 2.1 time: 0.084610 Aug 02 21:51:53.815915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 490/1006] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:51:53 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:51:54.841419 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6b5d6891-fdd4-47a8-8a16-e90e1b4468ad tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:54.842044 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6b5d6891-fdd4-47a8-8a16-e90e1b4468ad tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:54.848307 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b5d6891-fdd4-47a8-8a16-e90e1b4468ad tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:54.848768 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b5d6891-fdd4-47a8-8a16-e90e1b4468ad tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:54.849601 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b5d6891-fdd4-47a8-8a16-e90e1b4468ad tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:54.850062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b5d6891-fdd4-47a8-8a16-e90e1b4468ad tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:54.914735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6b5d6891-fdd4-47a8-8a16-e90e1b4468ad tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:51:54.922443 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6b5d6891-fdd4-47a8-8a16-e90e1b4468ad tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1266 microversion: 2.1 time: 0.085453 Aug 02 21:51:54.922990 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 517/1007] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:51:54 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:51:55.943331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3de58d04-36d1-4b18-8252-20f212a575b4 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:55.944548 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3de58d04-36d1-4b18-8252-20f212a575b4 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:55.952250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3de58d04-36d1-4b18-8252-20f212a575b4 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:55.952705 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3de58d04-36d1-4b18-8252-20f212a575b4 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:55.953785 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3de58d04-36d1-4b18-8252-20f212a575b4 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:55.954223 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3de58d04-36d1-4b18-8252-20f212a575b4 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:56.167985 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3de58d04-36d1-4b18-8252-20f212a575b4 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:51:56.175845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3de58d04-36d1-4b18-8252-20f212a575b4 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.236533 Aug 02 21:51:56.176669 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 491/1008] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:51:55 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:51:56.849347 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-fd47260e-ea07-417c-8e3f-f05134baa3d2 req-31811b4f-319c-44be-b38b-89af9b84030c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9d4eab-7355-4c2b-835e-a74edd4489e1", "tag": "26bcf8e3-2aaa-4b34-83da-9b048a6b3fe0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:51:56.859598 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-fd47260e-ea07-417c-8e3f-f05134baa3d2 req-31811b4f-319c-44be-b38b-89af9b84030c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:56.860054 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-fd47260e-ea07-417c-8e3f-f05134baa3d2 req-31811b4f-319c-44be-b38b-89af9b84030c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:56.872662 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-fd47260e-ea07-417c-8e3f-f05134baa3d2 req-31811b4f-319c-44be-b38b-89af9b84030c service nova] Creating event network-changed:26bcf8e3-2aaa-4b34-83da-9b048a6b3fe0 for instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 on hv-cinder-85144 Aug 02 21:51:56.877694 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-fd47260e-ea07-417c-8e3f-f05134baa3d2 req-31811b4f-319c-44be-b38b-89af9b84030c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167174 Aug 02 21:51:56.878285 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 518/1009] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:51:57.201513 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-085c483c-4405-412b-8e0e-eb9e3d7a7526 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:57.202156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-085c483c-4405-412b-8e0e-eb9e3d7a7526 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:57.208618 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-085c483c-4405-412b-8e0e-eb9e3d7a7526 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:57.209085 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-085c483c-4405-412b-8e0e-eb9e3d7a7526 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:57.210493 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-085c483c-4405-412b-8e0e-eb9e3d7a7526 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:57.210936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-085c483c-4405-412b-8e0e-eb9e3d7a7526 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:57.346361 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-085c483c-4405-412b-8e0e-eb9e3d7a7526 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:51:57.353941 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-085c483c-4405-412b-8e0e-eb9e3d7a7526 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.156375 Aug 02 21:51:57.354510 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 492/1010] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:51:57 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:51:58.377338 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-34538109-ece6-446f-98b0-ed291c3400e5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:58.378154 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-34538109-ece6-446f-98b0-ed291c3400e5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:58.384981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34538109-ece6-446f-98b0-ed291c3400e5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:58.385468 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34538109-ece6-446f-98b0-ed291c3400e5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:58.386249 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34538109-ece6-446f-98b0-ed291c3400e5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:58.386694 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34538109-ece6-446f-98b0-ed291c3400e5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:58.522782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-34538109-ece6-446f-98b0-ed291c3400e5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:51:58.530795 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-34538109-ece6-446f-98b0-ed291c3400e5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.159203 Aug 02 21:51:58.531399 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 519/1011] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:51:58 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:51:59.551156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-01c87f2f-2701-4762-a77d-5abc785e3576 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:51:59.552078 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-01c87f2f-2701-4762-a77d-5abc785e3576 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:51:59.559392 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-01c87f2f-2701-4762-a77d-5abc785e3576 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:59.559847 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-01c87f2f-2701-4762-a77d-5abc785e3576 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:59.560662 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-01c87f2f-2701-4762-a77d-5abc785e3576 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:51:59.561112 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-01c87f2f-2701-4762-a77d-5abc785e3576 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:51:59.702319 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-01c87f2f-2701-4762-a77d-5abc785e3576 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:51:59.714323 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-01c87f2f-2701-4762-a77d-5abc785e3576 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.165832 Aug 02 21:51:59.714323 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 493/1012] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:51:59 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:00.736240 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9c50dbcb-23de-4756-bba7-4374ed9fe506 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:00.736936 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9c50dbcb-23de-4756-bba7-4374ed9fe506 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:00.746921 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c50dbcb-23de-4756-bba7-4374ed9fe506 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:00.747446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c50dbcb-23de-4756-bba7-4374ed9fe506 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:00.748392 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c50dbcb-23de-4756-bba7-4374ed9fe506 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:00.748840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9c50dbcb-23de-4756-bba7-4374ed9fe506 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:00.894261 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9c50dbcb-23de-4756-bba7-4374ed9fe506 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:00.902021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9c50dbcb-23de-4756-bba7-4374ed9fe506 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.170970 Aug 02 21:52:00.902583 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 520/1013] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:00 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:52:01.923914 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-95c0da30-62dd-414d-bb16-5c88808bec64 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:01.924931 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-95c0da30-62dd-414d-bb16-5c88808bec64 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:01.931755 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-95c0da30-62dd-414d-bb16-5c88808bec64 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:01.932441 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-95c0da30-62dd-414d-bb16-5c88808bec64 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:01.933738 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-95c0da30-62dd-414d-bb16-5c88808bec64 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:01.934141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-95c0da30-62dd-414d-bb16-5c88808bec64 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:02.087478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-95c0da30-62dd-414d-bb16-5c88808bec64 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:02.095403 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-95c0da30-62dd-414d-bb16-5c88808bec64 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.176433 Aug 02 21:52:02.096043 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 494/1014] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:01 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:03.118365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e64c45cf-95dc-4d49-a980-e369e2144e36 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:03.118979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e64c45cf-95dc-4d49-a980-e369e2144e36 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:03.125242 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e64c45cf-95dc-4d49-a980-e369e2144e36 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:03.125699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e64c45cf-95dc-4d49-a980-e369e2144e36 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:03.126472 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e64c45cf-95dc-4d49-a980-e369e2144e36 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:03.126943 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e64c45cf-95dc-4d49-a980-e369e2144e36 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:03.269616 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e64c45cf-95dc-4d49-a980-e369e2144e36 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:03.277809 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e64c45cf-95dc-4d49-a980-e369e2144e36 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.163462 Aug 02 21:52:03.278392 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 521/1015] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:03 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:52:03.811047 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:03.825425 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-4888360b-be4e-41f1-a410-6fa59896c344 req-4c6651d1-e53c-4262-a9c7-9fbbf6efd432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9d4eab-7355-4c2b-835e-a74edd4489e1", "name": "network-vif-plugged", "status": "completed", "tag": "26bcf8e3-2aaa-4b34-83da-9b048a6b3fe0"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:03.835663 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-4888360b-be4e-41f1-a410-6fa59896c344 req-4c6651d1-e53c-4262-a9c7-9fbbf6efd432 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:03.836044 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-4888360b-be4e-41f1-a410-6fa59896c344 req-4c6651d1-e53c-4262-a9c7-9fbbf6efd432 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:03.847295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-4888360b-be4e-41f1-a410-6fa59896c344 req-4c6651d1-e53c-4262-a9c7-9fbbf6efd432 service nova] Creating event network-vif-plugged:26bcf8e3-2aaa-4b34-83da-9b048a6b3fe0 for instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 on hv-cinder-85144 Aug 02 21:52:03.852902 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-4888360b-be4e-41f1-a410-6fa59896c344 req-4c6651d1-e53c-4262-a9c7-9fbbf6efd432 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103673 Aug 02 21:52:03.854228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 495/1016] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:52:04.300786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ad6ced1e-c8f0-4ab7-8f07-65df8026ed3c tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:04.301414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ad6ced1e-c8f0-4ab7-8f07-65df8026ed3c tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:04.303366 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:04.304191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:04.310705 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad6ced1e-c8f0-4ab7-8f07-65df8026ed3c tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:04.311172 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad6ced1e-c8f0-4ab7-8f07-65df8026ed3c tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:04.311984 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad6ced1e-c8f0-4ab7-8f07-65df8026ed3c tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:04.312447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ad6ced1e-c8f0-4ab7-8f07-65df8026ed3c tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:04.458409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ad6ced1e-c8f0-4ab7-8f07-65df8026ed3c tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:04.469223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ad6ced1e-c8f0-4ab7-8f07-65df8026ed3c tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.172320 Aug 02 21:52:04.470364 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 522/1017] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:04 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:05.500958 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-251e8a72-f56a-44b5-985d-94d499eaf60f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:05.501670 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-251e8a72-f56a-44b5-985d-94d499eaf60f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:05.508067 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-251e8a72-f56a-44b5-985d-94d499eaf60f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:05.508563 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-251e8a72-f56a-44b5-985d-94d499eaf60f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:05.509356 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-251e8a72-f56a-44b5-985d-94d499eaf60f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:05.515788 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-251e8a72-f56a-44b5-985d-94d499eaf60f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:05.651090 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-251e8a72-f56a-44b5-985d-94d499eaf60f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:05.659074 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-251e8a72-f56a-44b5-985d-94d499eaf60f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1314 microversion: 2.1 time: 0.166034 Aug 02 21:52:05.659683 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 496/1018] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:05 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:06.679422 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ca80a3f4-d32a-4731-978f-b47f2c58b4e9 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:06.680053 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ca80a3f4-d32a-4731-978f-b47f2c58b4e9 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:06.686866 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ca80a3f4-d32a-4731-978f-b47f2c58b4e9 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:06.687324 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ca80a3f4-d32a-4731-978f-b47f2c58b4e9 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:06.688121 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ca80a3f4-d32a-4731-978f-b47f2c58b4e9 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:06.688591 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ca80a3f4-d32a-4731-978f-b47f2c58b4e9 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:06.828660 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ca80a3f4-d32a-4731-978f-b47f2c58b4e9 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:06.839833 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ca80a3f4-d32a-4731-978f-b47f2c58b4e9 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1497 microversion: 2.1 time: 0.164200 Aug 02 21:52:06.840790 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 523/1019] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:06 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:07.394385 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8f606ce1-b001-43ef-826d-faf308eafe9a tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:07.394886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8f606ce1-b001-43ef-826d-faf308eafe9a tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:07.403257 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8f606ce1-b001-43ef-826d-faf308eafe9a tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:07.403706 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8f606ce1-b001-43ef-826d-faf308eafe9a tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:07.404704 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8f606ce1-b001-43ef-826d-faf308eafe9a tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:07.405205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8f606ce1-b001-43ef-826d-faf308eafe9a tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:07.435432 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8f606ce1-b001-43ef-826d-faf308eafe9a tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:52:07.534247 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8f606ce1-b001-43ef-826d-faf308eafe9a tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 204 len: 0 microversion: 2.1 time: 0.143429 Aug 02 21:52:07.534843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 497/1020] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:52:07 2022] DELETE /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:52:07.543740 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f12e3c72-d3bc-459d-a8b3-1fe92b80534e tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:07.544375 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f12e3c72-d3bc-459d-a8b3-1fe92b80534e tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:07.550925 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f12e3c72-d3bc-459d-a8b3-1fe92b80534e tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:07.551577 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f12e3c72-d3bc-459d-a8b3-1fe92b80534e tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:07.552865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f12e3c72-d3bc-459d-a8b3-1fe92b80534e tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:07.553457 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f12e3c72-d3bc-459d-a8b3-1fe92b80534e tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:07.712228 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-f12e3c72-d3bc-459d-a8b3-1fe92b80534e tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:07.721064 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f12e3c72-d3bc-459d-a8b3-1fe92b80534e tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1503 microversion: 2.1 time: 0.181663 Aug 02 21:52:07.721652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 524/1021] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:07 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:08.742674 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2e04e313-a8be-4a46-9f4f-e8148dc57731 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:08.743385 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2e04e313-a8be-4a46-9f4f-e8148dc57731 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:08.750666 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2e04e313-a8be-4a46-9f4f-e8148dc57731 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:08.751116 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2e04e313-a8be-4a46-9f4f-e8148dc57731 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:08.751999 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2e04e313-a8be-4a46-9f4f-e8148dc57731 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:08.752470 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2e04e313-a8be-4a46-9f4f-e8148dc57731 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:08.900369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2e04e313-a8be-4a46-9f4f-e8148dc57731 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:08.908723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2e04e313-a8be-4a46-9f4f-e8148dc57731 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1503 microversion: 2.1 time: 0.170248 Aug 02 21:52:08.909316 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 498/1022] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:08 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:09.734780 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-cfe41d73-4b4c-464b-91b9-c4b9b71cd629 req-b2ce970f-1fdb-4a14-a7c5-d5790166fc19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9d4eab-7355-4c2b-835e-a74edd4489e1", "name": "network-vif-deleted", "tag": "26bcf8e3-2aaa-4b34-83da-9b048a6b3fe0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:09.746021 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-cfe41d73-4b4c-464b-91b9-c4b9b71cd629 req-b2ce970f-1fdb-4a14-a7c5-d5790166fc19 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:09.746466 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-cfe41d73-4b4c-464b-91b9-c4b9b71cd629 req-b2ce970f-1fdb-4a14-a7c5-d5790166fc19 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:09.758237 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-cfe41d73-4b4c-464b-91b9-c4b9b71cd629 req-b2ce970f-1fdb-4a14-a7c5-d5790166fc19 service nova] Creating event network-vif-deleted:26bcf8e3-2aaa-4b34-83da-9b048a6b3fe0 for instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 on hv-cinder-85144 Aug 02 21:52:09.763369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-cfe41d73-4b4c-464b-91b9-c4b9b71cd629 req-b2ce970f-1fdb-4a14-a7c5-d5790166fc19 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032193 Aug 02 21:52:09.763969 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 525/1023] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:52:09.931234 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:09.932020 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:09.938662 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:09.939110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:09.939887 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:09.940363 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:09.975769 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:09.976244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:09.976697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lazy-loading 'fault' on Instance uuid ac9d4eab-7355-4c2b-835e-a74edd4489e1 {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:52:10.029164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:10.043654 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-850c9b62-66a7-4573-85df-0e4a3d8817a5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 200 len: 1304 microversion: 2.1 time: 0.116863 Aug 02 21:52:10.044291 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 499/1024] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:09 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:11.065948 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:11.066889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: ac9d4eab-7355-4c2b-835e-a74edd4489e1] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:11.073427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:11.073889 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:11.074679 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:11.075123 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:11.088911 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] HTTP exception thrown: Instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 could not be found. Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Request method failure captured: Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 HTTP/1.1 Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zx2BtbefWWvWO1J4NXWPG9cFkv-SRVX7vTgy7tzyQn-yMo9nYXrTC7YCqHldPfFF6BrgwS6o3zWP3Airu8I4gCphiJiacxPjp7vUl17D15jHBSaRogRYEmAZfTe7t4fH6cbVjRIL9Pl20XOz1-c45EgKUrlJyIz5HMNSo-GgbAVEcw Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 3c6e4e1e12db464ba903886b1da734c1 Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesActionsTest-1183336585 Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:52:11.090677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3c6e4e1e12db464ba903886b1da734c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3c6e4e1e12db464ba903886b1da734c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3c6e4e1e12db464ba903886b1da734c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3c6e4e1e12db464ba903886b1da734c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesActionsTest-1183336585 Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 3c6e4e1e12db464ba903886b1da734c1 Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesActionsTest-1183336585 Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesActionsTest-1183336585-project Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 1e71494efbc64a76bc7d69f9d3bb7b89 Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesActionsTest-1183336585-project Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 could not be found. Aug 02 21:52:11.092411 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'ac9d4eab-7355-4c2b-835e-a74edd4489e1'} Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 could not be found. Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:52:11.093445 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 could not be found. Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 could not be found. Aug 02 21:52:11.095067 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:11.096528 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Returning 404 to user: Instance ac9d4eab-7355-4c2b-835e-a74edd4489e1 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:52:11.096528 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a91ed045-d29c-4a12-bc4f-b427cda09bdd tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1" status: 404 len: 111 microversion: 2.1 time: 0.031085 Aug 02 21:52:11.096528 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 526/1025] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:11 2022] GET /compute/v2.1/servers/ac9d4eab-7355-4c2b-835e-a74edd4489e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:52:11.252950 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2009030270", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "networks": [{"uuid": "646216ff-945f-4723-94c9-5a14e6186faa"}]}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:11.308843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] validate_networks() for [('646216ff-945f-4723-94c9-5a14e6186faa', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:52:11.781726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:52:11.782174 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:52:11.782646 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:52:11.783052 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:52:11.783464 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:52:11.795009 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:11.795463 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:11.796305 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:11.796763 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:11.815431 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Getting quotas for project 3c6e4e1e12db464ba903886b1da734c1. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:52:11.819278 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Getting quotas for user 1e71494efbc64a76bc7d69f9d3bb7b89 and project 3c6e4e1e12db464ba903886b1da734c1. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:52:11.831478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:52:11.833771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:52:11.881182 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-cc08e744-d4bd-4e24-8ad1-655251532b9d tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631994 Aug 02 21:52:11.881833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 500/1026] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:52:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:52:11.893153 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-da5290f4-905e-4a53-8b3d-70c657812d72 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:11.893774 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-da5290f4-905e-4a53-8b3d-70c657812d72 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:11.950863 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-da5290f4-905e-4a53-8b3d-70c657812d72 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:11.957942 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-da5290f4-905e-4a53-8b3d-70c657812d72 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1214 microversion: 2.1 time: 0.068620 Aug 02 21:52:11.958519 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 527/1027] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:11 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:12.983904 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3037ce55-7b93-4aa2-9fbd-69b33879058f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:12.984560 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3037ce55-7b93-4aa2-9fbd-69b33879058f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:12.991817 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3037ce55-7b93-4aa2-9fbd-69b33879058f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:12.992714 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3037ce55-7b93-4aa2-9fbd-69b33879058f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:12.993534 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3037ce55-7b93-4aa2-9fbd-69b33879058f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:12.994555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3037ce55-7b93-4aa2-9fbd-69b33879058f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:13.076395 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-3037ce55-7b93-4aa2-9fbd-69b33879058f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:13.085505 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3037ce55-7b93-4aa2-9fbd-69b33879058f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1284 microversion: 2.1 time: 0.105450 Aug 02 21:52:13.086091 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 501/1028] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:12 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:14.109181 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-47fb44f0-7480-46f8-b18a-6eb1b168a616 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:14.110049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-47fb44f0-7480-46f8-b18a-6eb1b168a616 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:14.117270 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47fb44f0-7480-46f8-b18a-6eb1b168a616 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:14.117721 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47fb44f0-7480-46f8-b18a-6eb1b168a616 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:14.118517 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47fb44f0-7480-46f8-b18a-6eb1b168a616 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:14.119600 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-47fb44f0-7480-46f8-b18a-6eb1b168a616 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:14.269120 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-47fb44f0-7480-46f8-b18a-6eb1b168a616 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:14.277569 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-47fb44f0-7480-46f8-b18a-6eb1b168a616 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1314 microversion: 2.1 time: 0.173350 Aug 02 21:52:14.278219 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 528/1029] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:14 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:14.301722 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-a463e82f-6206-4461-b6c2-e4bcd6f74f36 req-1c690808-5028-453a-ae3c-ddd279097ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0def83-ce78-478b-a5a8-759076c5a6fc", "tag": "ba42c130-d7a3-48df-b718-b488c731fd3c"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:14.320368 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-a463e82f-6206-4461-b6c2-e4bcd6f74f36 req-1c690808-5028-453a-ae3c-ddd279097ad8 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:14.320996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-a463e82f-6206-4461-b6c2-e4bcd6f74f36 req-1c690808-5028-453a-ae3c-ddd279097ad8 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:14.334832 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-a463e82f-6206-4461-b6c2-e4bcd6f74f36 req-1c690808-5028-453a-ae3c-ddd279097ad8 service nova] Creating event network-changed:ba42c130-d7a3-48df-b718-b488c731fd3c for instance bc0def83-ce78-478b-a5a8-759076c5a6fc on hv-cinder-85144 Aug 02 21:52:14.342515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-a463e82f-6206-4461-b6c2-e4bcd6f74f36 req-1c690808-5028-453a-ae3c-ddd279097ad8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044501 Aug 02 21:52:14.343286 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 502/1030] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:52:15.300780 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b574da4d-cf99-4f85-976a-9406c3c8ad37 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:15.301393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b574da4d-cf99-4f85-976a-9406c3c8ad37 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:15.308549 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b574da4d-cf99-4f85-976a-9406c3c8ad37 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:15.308998 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b574da4d-cf99-4f85-976a-9406c3c8ad37 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:15.309778 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b574da4d-cf99-4f85-976a-9406c3c8ad37 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:15.310221 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b574da4d-cf99-4f85-976a-9406c3c8ad37 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:15.444743 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b574da4d-cf99-4f85-976a-9406c3c8ad37 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:15.452979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b574da4d-cf99-4f85-976a-9406c3c8ad37 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1314 microversion: 2.1 time: 0.156080 Aug 02 21:52:15.453549 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 529/1031] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:15 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:16.474860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d01cb003-419f-4641-8d93-96305dae3586 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:16.475635 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d01cb003-419f-4641-8d93-96305dae3586 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:16.482570 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d01cb003-419f-4641-8d93-96305dae3586 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:16.483019 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d01cb003-419f-4641-8d93-96305dae3586 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:16.483796 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d01cb003-419f-4641-8d93-96305dae3586 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:16.484254 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d01cb003-419f-4641-8d93-96305dae3586 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:16.627035 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-d01cb003-419f-4641-8d93-96305dae3586 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:16.635837 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d01cb003-419f-4641-8d93-96305dae3586 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1314 microversion: 2.1 time: 0.165725 Aug 02 21:52:16.636533 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 503/1032] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:16 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:17.664045 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3fc4f4e5-26f4-4ea0-a645-99016925fd38 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:17.664605 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3fc4f4e5-26f4-4ea0-a645-99016925fd38 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:17.671456 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3fc4f4e5-26f4-4ea0-a645-99016925fd38 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:17.671913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3fc4f4e5-26f4-4ea0-a645-99016925fd38 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:17.672720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3fc4f4e5-26f4-4ea0-a645-99016925fd38 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:17.673159 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3fc4f4e5-26f4-4ea0-a645-99016925fd38 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:17.827530 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3fc4f4e5-26f4-4ea0-a645-99016925fd38 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:17.835891 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3fc4f4e5-26f4-4ea0-a645-99016925fd38 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1314 microversion: 2.1 time: 0.175675 Aug 02 21:52:17.836516 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 530/1033] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:17 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:52:18.857681 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-876e9ad3-6e95-491b-b843-8a82c6b59b55 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:18.858060 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-876e9ad3-6e95-491b-b843-8a82c6b59b55 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:18.864225 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-876e9ad3-6e95-491b-b843-8a82c6b59b55 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:18.864677 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-876e9ad3-6e95-491b-b843-8a82c6b59b55 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:18.865462 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-876e9ad3-6e95-491b-b843-8a82c6b59b55 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:18.865900 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-876e9ad3-6e95-491b-b843-8a82c6b59b55 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:19.016563 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-876e9ad3-6e95-491b-b843-8a82c6b59b55 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:19.024421 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-876e9ad3-6e95-491b-b843-8a82c6b59b55 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1314 microversion: 2.1 time: 0.171375 Aug 02 21:52:19.025003 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 504/1034] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:18 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:20.045168 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9cbfcdb2-82af-46e2-a5b4-f5d6e13de100 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:20.045826 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9cbfcdb2-82af-46e2-a5b4-f5d6e13de100 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:20.052368 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9cbfcdb2-82af-46e2-a5b4-f5d6e13de100 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:20.052824 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9cbfcdb2-82af-46e2-a5b4-f5d6e13de100 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:20.053604 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9cbfcdb2-82af-46e2-a5b4-f5d6e13de100 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:20.054049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9cbfcdb2-82af-46e2-a5b4-f5d6e13de100 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:20.184602 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9cbfcdb2-82af-46e2-a5b4-f5d6e13de100 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:20.192049 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9cbfcdb2-82af-46e2-a5b4-f5d6e13de100 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1314 microversion: 2.1 time: 0.150738 Aug 02 21:52:20.192649 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 531/1035] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:20 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:21.213446 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6d2b64ad-e5e5-4da8-940f-20e2ad0278cc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:21.213971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6d2b64ad-e5e5-4da8-940f-20e2ad0278cc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:21.220509 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6d2b64ad-e5e5-4da8-940f-20e2ad0278cc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:21.220971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6d2b64ad-e5e5-4da8-940f-20e2ad0278cc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:21.221749 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6d2b64ad-e5e5-4da8-940f-20e2ad0278cc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:21.222196 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6d2b64ad-e5e5-4da8-940f-20e2ad0278cc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:21.356282 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6d2b64ad-e5e5-4da8-940f-20e2ad0278cc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:21.363802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6d2b64ad-e5e5-4da8-940f-20e2ad0278cc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1314 microversion: 2.1 time: 0.154989 Aug 02 21:52:21.364395 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 505/1036] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:21 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:21.833946 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-fad64614-942f-4422-aa87-fd15828926ee req-124bd678-9961-4ba4-b050-cf8b611085d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0def83-ce78-478b-a5a8-759076c5a6fc", "name": "network-vif-plugged", "status": "completed", "tag": "ba42c130-d7a3-48df-b718-b488c731fd3c"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:21.845379 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-fad64614-942f-4422-aa87-fd15828926ee req-124bd678-9961-4ba4-b050-cf8b611085d4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:21.845845 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-fad64614-942f-4422-aa87-fd15828926ee req-124bd678-9961-4ba4-b050-cf8b611085d4 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:21.859892 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-fad64614-942f-4422-aa87-fd15828926ee req-124bd678-9961-4ba4-b050-cf8b611085d4 service nova] Creating event network-vif-plugged:ba42c130-d7a3-48df-b718-b488c731fd3c for instance bc0def83-ce78-478b-a5a8-759076c5a6fc on hv-cinder-85144 Aug 02 21:52:21.865041 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-fad64614-942f-4422-aa87-fd15828926ee req-124bd678-9961-4ba4-b050-cf8b611085d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034943 Aug 02 21:52:21.865642 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 532/1037] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:52:22.385531 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4a023bcc-b33d-408b-bd5e-2c56c0f2b8f5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:22.386156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4a023bcc-b33d-408b-bd5e-2c56c0f2b8f5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:22.388697 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:22.389544 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=6 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:22.396010 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4a023bcc-b33d-408b-bd5e-2c56c0f2b8f5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:22.396517 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4a023bcc-b33d-408b-bd5e-2c56c0f2b8f5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:22.397314 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4a023bcc-b33d-408b-bd5e-2c56c0f2b8f5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:22.397791 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4a023bcc-b33d-408b-bd5e-2c56c0f2b8f5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:22.539272 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4a023bcc-b33d-408b-bd5e-2c56c0f2b8f5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:22.547242 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4a023bcc-b33d-408b-bd5e-2c56c0f2b8f5 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1314 microversion: 2.1 time: 0.165905 Aug 02 21:52:22.547812 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 506/1038] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:22 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:23.571426 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-76b2858d-0458-4f50-8d24-52dfbbcbeabc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:23.572777 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-76b2858d-0458-4f50-8d24-52dfbbcbeabc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:23.574762 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:23.575886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:23.581279 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-76b2858d-0458-4f50-8d24-52dfbbcbeabc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:23.581734 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-76b2858d-0458-4f50-8d24-52dfbbcbeabc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:23.582587 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-76b2858d-0458-4f50-8d24-52dfbbcbeabc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:23.583060 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-76b2858d-0458-4f50-8d24-52dfbbcbeabc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:23.586436 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=77 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:23.716821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-76b2858d-0458-4f50-8d24-52dfbbcbeabc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:23.726439 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-76b2858d-0458-4f50-8d24-52dfbbcbeabc tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1496 microversion: 2.1 time: 0.159216 Aug 02 21:52:23.727013 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 533/1039] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:23 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:24.252875 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-57e61c3f-6df1-419e-8fe8-3b344c7a4091 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:24.253394 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-57e61c3f-6df1-419e-8fe8-3b344c7a4091 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:24.255651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:24.261674 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-57e61c3f-6df1-419e-8fe8-3b344c7a4091 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:24.262126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-57e61c3f-6df1-419e-8fe8-3b344c7a4091 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:24.262939 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-57e61c3f-6df1-419e-8fe8-3b344c7a4091 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:24.263377 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-57e61c3f-6df1-419e-8fe8-3b344c7a4091 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:24.267134 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:24.292417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-57e61c3f-6df1-419e-8fe8-3b344c7a4091 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:52:24.372029 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-57e61c3f-6df1-419e-8fe8-3b344c7a4091 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 204 len: 0 microversion: 2.1 time: 0.122663 Aug 02 21:52:24.373064 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 507/1040] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:52:24 2022] DELETE /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:52:24.381503 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2c178867-d0f2-431a-8efd-a6f01b20214f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:24.382164 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2c178867-d0f2-431a-8efd-a6f01b20214f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:24.389070 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c178867-d0f2-431a-8efd-a6f01b20214f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:24.389533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c178867-d0f2-431a-8efd-a6f01b20214f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:24.390324 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c178867-d0f2-431a-8efd-a6f01b20214f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:24.390772 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2c178867-d0f2-431a-8efd-a6f01b20214f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:24.525899 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2c178867-d0f2-431a-8efd-a6f01b20214f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:24.533494 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2c178867-d0f2-431a-8efd-a6f01b20214f tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1502 microversion: 2.1 time: 0.155777 Aug 02 21:52:24.534055 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 534/1041] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:24 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:25.554827 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4ff14642-92ec-49d3-82c8-8bca3910812b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:25.555545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4ff14642-92ec-49d3-82c8-8bca3910812b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:25.562117 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4ff14642-92ec-49d3-82c8-8bca3910812b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:25.562573 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4ff14642-92ec-49d3-82c8-8bca3910812b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:25.563348 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4ff14642-92ec-49d3-82c8-8bca3910812b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:25.563784 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4ff14642-92ec-49d3-82c8-8bca3910812b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:25.703430 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4ff14642-92ec-49d3-82c8-8bca3910812b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:25.711471 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4ff14642-92ec-49d3-82c8-8bca3910812b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1502 microversion: 2.1 time: 0.160944 Aug 02 21:52:25.712054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 508/1042] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:25 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:26.589659 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-76747d88-2c98-40e6-819d-03a8cb1c6d8a req-95c4070c-1039-491e-bb3b-c1ce7a14b9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0def83-ce78-478b-a5a8-759076c5a6fc", "name": "network-vif-deleted", "tag": "ba42c130-d7a3-48df-b718-b488c731fd3c"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:26.599515 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-76747d88-2c98-40e6-819d-03a8cb1c6d8a req-95c4070c-1039-491e-bb3b-c1ce7a14b9a3 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:26.599885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-76747d88-2c98-40e6-819d-03a8cb1c6d8a req-95c4070c-1039-491e-bb3b-c1ce7a14b9a3 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:26.617499 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-76747d88-2c98-40e6-819d-03a8cb1c6d8a req-95c4070c-1039-491e-bb3b-c1ce7a14b9a3 service nova] Creating event network-vif-deleted:ba42c130-d7a3-48df-b718-b488c731fd3c for instance bc0def83-ce78-478b-a5a8-759076c5a6fc on hv-cinder-85144 Aug 02 21:52:26.624301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-76747d88-2c98-40e6-819d-03a8cb1c6d8a req-95c4070c-1039-491e-bb3b-c1ce7a14b9a3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039758 Aug 02 21:52:26.624941 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 535/1043] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:52:26.733908 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:26.734710 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:26.741954 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:26.742404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:26.743195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:26.744145 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:26.777069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:26.777521 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:26.777971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lazy-loading 'fault' on Instance uuid bc0def83-ce78-478b-a5a8-759076c5a6fc {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:52:26.822010 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e71494efbc64a76bc7d69f9d3bb7b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6e4e1e12db464ba903886b1da734c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:26.830333 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4bc2fe84-534f-4e94-a444-d7e62ef9100b tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 200 len: 1304 microversion: 2.1 time: 0.100564 Aug 02 21:52:26.830907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 509/1044] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:26 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:27.853154 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:27.853897 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] [instance: bc0def83-ce78-478b-a5a8-759076c5a6fc] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:27.860117 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:27.860597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:27.861369 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:27.861808 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:27.875521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] HTTP exception thrown: Instance bc0def83-ce78-478b-a5a8-759076c5a6fc could not be found. Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Request method failure captured: Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc HTTP/1.1 Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6Zx2BtbefWWvWO1J4NXWPG9cFkv-SRVX7vTgy7tzyQn-yMo9nYXrTC7YCqHldPfFF6BrgwS6o3zWP3Airu8I4gCphiJiacxPjp7vUl17D15jHBSaRogRYEmAZfTe7t4fH6cbVjRIL9Pl20XOz1-c45EgKUrlJyIz5HMNSo-GgbAVEcw Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 3c6e4e1e12db464ba903886b1da734c1 Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesActionsTest-1183336585 Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:52:27.877213 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3c6e4e1e12db464ba903886b1da734c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3c6e4e1e12db464ba903886b1da734c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3c6e4e1e12db464ba903886b1da734c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3c6e4e1e12db464ba903886b1da734c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesActionsTest-1183336585 Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 3c6e4e1e12db464ba903886b1da734c1 Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesActionsTest-1183336585 Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesActionsTest-1183336585-project Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 1e71494efbc64a76bc7d69f9d3bb7b89 Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesActionsTest-1183336585-project Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance bc0def83-ce78-478b-a5a8-759076c5a6fc could not be found. Aug 02 21:52:27.878865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'bc0def83-ce78-478b-a5a8-759076c5a6fc'} Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0def83-ce78-478b-a5a8-759076c5a6fc could not be found. Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:52:27.879819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0def83-ce78-478b-a5a8-759076c5a6fc could not be found. Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0def83-ce78-478b-a5a8-759076c5a6fc could not be found. Aug 02 21:52:27.881329 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:27.882708 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] Returning 404 to user: Instance bc0def83-ce78-478b-a5a8-759076c5a6fc could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:52:27.882708 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5256812e-319a-4e7e-b7b4-ad76a4fbb438 tempest-VolumesActionsTest-1183336585 tempest-VolumesActionsTest-1183336585-project] 10.222.0.57 "GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc" status: 404 len: 111 microversion: 2.1 time: 0.030612 Aug 02 21:52:27.882708 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 536/1045] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:27 2022] GET /compute/v2.1/servers/bc0def83-ce78-478b-a5a8-759076c5a6fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:52:51.933478 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-732a5f6c-690c-44d9-b7ba-b207c75b83f3 req-f9811954-dcbb-4210-b214-cbccc6234a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834de2b6-db09-4c6d-bd2d-4642f520cb3b", "tag": "fda0d1b6-b89a-490d-9981-2e3fa33efca2"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:51.934574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-fb7600d0-0737-42cc-bb69-2cae1163b045 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:51.935815 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fb7600d0-0737-42cc-bb69-2cae1163b045 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:51.943032 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:51.944056 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:51.946888 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=7 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:51.948440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=15 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:51.949250 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fb7600d0-0737-42cc-bb69-2cae1163b045 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:51.950024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fb7600d0-0737-42cc-bb69-2cae1163b045 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:51.950851 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-732a5f6c-690c-44d9-b7ba-b207c75b83f3 req-f9811954-dcbb-4210-b214-cbccc6234a1c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:51.951474 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-732a5f6c-690c-44d9-b7ba-b207c75b83f3 req-f9811954-dcbb-4210-b214-cbccc6234a1c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:51.952173 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fb7600d0-0737-42cc-bb69-2cae1163b045 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:51.953680 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-fb7600d0-0737-42cc-bb69-2cae1163b045 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:51.964626 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-732a5f6c-690c-44d9-b7ba-b207c75b83f3 req-f9811954-dcbb-4210-b214-cbccc6234a1c service nova] Creating event network-changed:fda0d1b6-b89a-490d-9981-2e3fa33efca2 for instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b on hv-cinder-85144 Aug 02 21:52:51.970106 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-732a5f6c-690c-44d9-b7ba-b207c75b83f3 req-f9811954-dcbb-4210-b214-cbccc6234a1c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040563 Aug 02 21:52:51.973180 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 537/1046] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:52:51.993525 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-fb7600d0-0737-42cc-bb69-2cae1163b045 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:52:52.116886 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-fb7600d0-0737-42cc-bb69-2cae1163b045 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "DELETE /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 204 len: 0 microversion: 2.1 time: 0.188380 Aug 02 21:52:52.118627 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 510/1047] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:52:51 2022] DELETE /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:52:52.128115 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-34130690-7957-4aec-87c6-41c87fe38f15 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:52.129035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-34130690-7957-4aec-87c6-41c87fe38f15 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:52.137092 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34130690-7957-4aec-87c6-41c87fe38f15 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:52.137593 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34130690-7957-4aec-87c6-41c87fe38f15 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:52.138521 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34130690-7957-4aec-87c6-41c87fe38f15 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:52.139203 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-34130690-7957-4aec-87c6-41c87fe38f15 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:52.283470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-34130690-7957-4aec-87c6-41c87fe38f15 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:52.301436 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-34130690-7957-4aec-87c6-41c87fe38f15 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1578 microversion: 2.1 time: 0.177707 Aug 02 21:52:52.316629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 538/1048] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:52 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:53.326529 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9cb09d4b-34a0-49dd-b3fd-e238ceadc4d6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:53.327274 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9cb09d4b-34a0-49dd-b3fd-e238ceadc4d6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:53.333908 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9cb09d4b-34a0-49dd-b3fd-e238ceadc4d6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:53.334594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9cb09d4b-34a0-49dd-b3fd-e238ceadc4d6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:53.335543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9cb09d4b-34a0-49dd-b3fd-e238ceadc4d6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:53.335980 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9cb09d4b-34a0-49dd-b3fd-e238ceadc4d6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:53.560602 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9cb09d4b-34a0-49dd-b3fd-e238ceadc4d6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:53.568580 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9cb09d4b-34a0-49dd-b3fd-e238ceadc4d6 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1578 microversion: 2.1 time: 0.246772 Aug 02 21:52:53.569172 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 511/1049] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:53 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1578 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:52:54.588806 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1369901476", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:54.593554 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1973c627-a7e4-4aa7-b3a7-3fa56ff1bf04 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:54.594311 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1973c627-a7e4-4aa7-b3a7-3fa56ff1bf04 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:54.601175 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1973c627-a7e4-4aa7-b3a7-3fa56ff1bf04 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:54.601552 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1973c627-a7e4-4aa7-b3a7-3fa56ff1bf04 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:54.602575 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1973c627-a7e4-4aa7-b3a7-3fa56ff1bf04 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:54.603041 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1973c627-a7e4-4aa7-b3a7-3fa56ff1bf04 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:54.661324 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] validate_networks() for None {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:52:54.685822 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-1973c627-a7e4-4aa7-b3a7-3fa56ff1bf04 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:54.693987 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1973c627-a7e4-4aa7-b3a7-3fa56ff1bf04 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 200 len: 1392 microversion: 2.1 time: 0.104265 Aug 02 21:52:54.694771 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 512/1050] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:54 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 1392 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:52:54.725777 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-bea2782b-30e8-47d5-ba01-ee5c52668bbf req-14dc817d-92f2-4af2-b745-541a17766e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834de2b6-db09-4c6d-bd2d-4642f520cb3b", "name": "network-vif-deleted", "tag": "fda0d1b6-b89a-490d-9981-2e3fa33efca2"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:54.734981 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-bea2782b-30e8-47d5-ba01-ee5c52668bbf req-14dc817d-92f2-4af2-b745-541a17766e30 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:54.735434 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-bea2782b-30e8-47d5-ba01-ee5c52668bbf req-14dc817d-92f2-4af2-b745-541a17766e30 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:54.748657 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-bea2782b-30e8-47d5-ba01-ee5c52668bbf req-14dc817d-92f2-4af2-b745-541a17766e30 service nova] Creating event network-vif-deleted:fda0d1b6-b89a-490d-9981-2e3fa33efca2 for instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b on hv-cinder-85144 Aug 02 21:52:54.754072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-bea2782b-30e8-47d5-ba01-ee5c52668bbf req-14dc817d-92f2-4af2-b745-541a17766e30 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032898 Aug 02 21:52:54.754889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 513/1051] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:52:54.976935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:52:54.977360 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:52:54.977832 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:52:54.978245 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:52:54.979429 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:52:54.992747 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:54.993212 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:54.994071 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:54.994519 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:55.013634 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Getting quotas for project 8c5722bb5e6649349d592852f0b80219. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:52:55.018400 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Getting quotas for user d1cdf68073bc425d8a552ec690aebb1c and project 8c5722bb5e6649349d592852f0b80219. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:52:55.032885 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:52:55.035357 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:52:55.085396 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a039db21-278c-447e-a47b-dd1451ca0846 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501626 Aug 02 21:52:55.086365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 539/1052] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 21:52:55.098475 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-571c11aa-7755-4d23-baaa-cc963d5970a6 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:55.099852 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-571c11aa-7755-4d23-baaa-cc963d5970a6 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:55.182481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-571c11aa-7755-4d23-baaa-cc963d5970a6 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:55.191210 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-571c11aa-7755-4d23-baaa-cc963d5970a6 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1215 microversion: 2.1 time: 0.097108 Aug 02 21:52:55.191799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 514/1053] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:55 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:55.716349 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:55.716979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 834de2b6-db09-4c6d-bd2d-4642f520cb3b] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:55.724151 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:55.724668 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:55.725735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:55.726257 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:55.740774 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] HTTP exception thrown: Instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b could not be found. Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Request method failure captured: Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b HTTP/1.1 Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZptPXPYJJOkTdro2ctbpZWDo_p7H2ffPBrIzoqEJubOddWwfCziIes1f_134xOYicx_i06iyx32AyFYMvoveudm94WY2t7_eGdXmkPudK_cScopamekvVIcGL4SH10x34RwO3mq2XAcNwPy34fkDSmxxo7-Z-UoD3Po3uX06zjQ4mo Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:52:55.742446 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 5377fd0bccf748dda1d0192080253dcf Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b could not be found. Aug 02 21:52:55.743937 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '834de2b6-db09-4c6d-bd2d-4642f520cb3b'} Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b could not be found. Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:52:55.746157 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b could not be found. Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b could not be found. Aug 02 21:52:55.747414 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:52:55.750184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Returning 404 to user: Instance 834de2b6-db09-4c6d-bd2d-4642f520cb3b could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:52:55.750184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-f2309cc3-92c3-40fb-b4be-ec84da7cfa47 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b" status: 404 len: 111 microversion: 2.1 time: 0.032743 Aug 02 21:52:55.750184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 540/1054] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:55 2022] GET /compute/v2.1/servers/834de2b6-db09-4c6d-bd2d-4642f520cb3b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:52:56.219400 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7e4c2e05-e1fa-4bb1-bd78-68e8693792f3 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:56.219995 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7e4c2e05-e1fa-4bb1-bd78-68e8693792f3 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:56.227279 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e4c2e05-e1fa-4bb1-bd78-68e8693792f3 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:56.227727 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e4c2e05-e1fa-4bb1-bd78-68e8693792f3 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:56.229095 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e4c2e05-e1fa-4bb1-bd78-68e8693792f3 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:56.229803 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e4c2e05-e1fa-4bb1-bd78-68e8693792f3 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:56.312967 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7e4c2e05-e1fa-4bb1-bd78-68e8693792f3 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:56.321383 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7e4c2e05-e1fa-4bb1-bd78-68e8693792f3 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1285 microversion: 2.1 time: 0.105834 Aug 02 21:52:56.321960 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 515/1055] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:56 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:52:57.342200 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b9c323a8-db5c-4c79-921a-99b9e7a6ec78 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:57.342805 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b9c323a8-db5c-4c79-921a-99b9e7a6ec78 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:57.349765 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b9c323a8-db5c-4c79-921a-99b9e7a6ec78 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:57.350208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b9c323a8-db5c-4c79-921a-99b9e7a6ec78 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:57.351898 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b9c323a8-db5c-4c79-921a-99b9e7a6ec78 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:57.352401 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b9c323a8-db5c-4c79-921a-99b9e7a6ec78 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:57.518982 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b9c323a8-db5c-4c79-921a-99b9e7a6ec78 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:57.526913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b9c323a8-db5c-4c79-921a-99b9e7a6ec78 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1315 microversion: 2.1 time: 0.189042 Aug 02 21:52:57.527474 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 541/1056] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:57 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:57.964255 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-dafcc2ed-5b11-4dcb-9152-13cb7aa1c430 req-22d32af3-b65b-4318-b460-af771ddd8967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8931f2b3-058f-4b08-abbe-1e42922a0d67", "tag": "f093ef18-76ea-45d9-b25e-8141939e39d2"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:57.974905 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-dafcc2ed-5b11-4dcb-9152-13cb7aa1c430 req-22d32af3-b65b-4318-b460-af771ddd8967 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:57.975342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-dafcc2ed-5b11-4dcb-9152-13cb7aa1c430 req-22d32af3-b65b-4318-b460-af771ddd8967 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:57.988116 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-dafcc2ed-5b11-4dcb-9152-13cb7aa1c430 req-22d32af3-b65b-4318-b460-af771ddd8967 service nova] Creating event network-changed:f093ef18-76ea-45d9-b25e-8141939e39d2 for instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 on hv-cinder-85144 Aug 02 21:52:57.992767 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-dafcc2ed-5b11-4dcb-9152-13cb7aa1c430 req-22d32af3-b65b-4318-b460-af771ddd8967 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032362 Aug 02 21:52:57.993704 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 516/1057] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:52:58.547556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-92dba037-941e-44af-aef6-47291f7060f4 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:58.548206 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-92dba037-941e-44af-aef6-47291f7060f4 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:58.554704 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92dba037-941e-44af-aef6-47291f7060f4 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:58.555160 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92dba037-941e-44af-aef6-47291f7060f4 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:58.555933 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92dba037-941e-44af-aef6-47291f7060f4 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:58.556404 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92dba037-941e-44af-aef6-47291f7060f4 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:58.775114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-92dba037-941e-44af-aef6-47291f7060f4 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:58.783177 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-92dba037-941e-44af-aef6-47291f7060f4 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1315 microversion: 2.1 time: 0.239535 Aug 02 21:52:58.783752 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 542/1058] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:58 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:52:58.935401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7092a3be-97b0-4b01-922a-fd617075022a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:58.936060 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7092a3be-97b0-4b01-922a-fd617075022a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:58.943320 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7092a3be-97b0-4b01-922a-fd617075022a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:58.943860 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7092a3be-97b0-4b01-922a-fd617075022a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:58.944754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7092a3be-97b0-4b01-922a-fd617075022a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:58.945310 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7092a3be-97b0-4b01-922a-fd617075022a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:58.974058 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7092a3be-97b0-4b01-922a-fd617075022a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:52:59.052810 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7092a3be-97b0-4b01-922a-fd617075022a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "DELETE /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 204 len: 0 microversion: 2.1 time: 0.121588 Aug 02 21:52:59.053704 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 517/1059] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:52:58 2022] DELETE /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:52:59.062369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b502bb22-f033-4c4a-b507-8932b9bf0f17 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:59.063069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b502bb22-f033-4c4a-b507-8932b9bf0f17 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:59.069182 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b502bb22-f033-4c4a-b507-8932b9bf0f17 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:59.069633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b502bb22-f033-4c4a-b507-8932b9bf0f17 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:59.070403 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b502bb22-f033-4c4a-b507-8932b9bf0f17 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:59.070848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b502bb22-f033-4c4a-b507-8932b9bf0f17 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:59.077119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-046e8f76-52cc-4353-ab2d-d2b3a09dd8f7 req-77ec79aa-7ec9-4e5d-99f5-edcff3a281e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ddda1b-801a-438b-a86c-df7d1340dfba", "tag": "65ee788b-1995-470a-8bd3-2409d32094e5"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:52:59.087082 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-046e8f76-52cc-4353-ab2d-d2b3a09dd8f7 req-77ec79aa-7ec9-4e5d-99f5-edcff3a281e1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:59.088449 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-046e8f76-52cc-4353-ab2d-d2b3a09dd8f7 req-77ec79aa-7ec9-4e5d-99f5-edcff3a281e1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:59.100183 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-046e8f76-52cc-4353-ab2d-d2b3a09dd8f7 req-77ec79aa-7ec9-4e5d-99f5-edcff3a281e1 service nova] Creating event network-changed:65ee788b-1995-470a-8bd3-2409d32094e5 for instance 43ddda1b-801a-438b-a86c-df7d1340dfba on hv-cinder-85144 Aug 02 21:52:59.106209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-046e8f76-52cc-4353-ab2d-d2b3a09dd8f7 req-77ec79aa-7ec9-4e5d-99f5-edcff3a281e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166162 Aug 02 21:52:59.106811 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 543/1060] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:52:59.210803 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b502bb22-f033-4c4a-b507-8932b9bf0f17 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:59.220883 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b502bb22-f033-4c4a-b507-8932b9bf0f17 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1577 microversion: 2.1 time: 0.162834 Aug 02 21:52:59.221576 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 518/1061] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:59 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:52:59.804971 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-146e434e-3efa-48b4-87bf-bf3aded5a87d tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:52:59.805809 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-146e434e-3efa-48b4-87bf-bf3aded5a87d tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:52:59.813812 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-146e434e-3efa-48b4-87bf-bf3aded5a87d tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:59.814266 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-146e434e-3efa-48b4-87bf-bf3aded5a87d tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:59.815045 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-146e434e-3efa-48b4-87bf-bf3aded5a87d tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:52:59.815482 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-146e434e-3efa-48b4-87bf-bf3aded5a87d tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:52:59.950376 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-146e434e-3efa-48b4-87bf-bf3aded5a87d tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:52:59.958398 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-146e434e-3efa-48b4-87bf-bf3aded5a87d tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1315 microversion: 2.1 time: 0.158894 Aug 02 21:52:59.958958 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 544/1062] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:52:59 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:00.243376 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-efc197e3-5ed4-4062-8e13-8810df4f161a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:00.243944 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-efc197e3-5ed4-4062-8e13-8810df4f161a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:00.250682 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-efc197e3-5ed4-4062-8e13-8810df4f161a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:00.251133 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-efc197e3-5ed4-4062-8e13-8810df4f161a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:00.251902 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-efc197e3-5ed4-4062-8e13-8810df4f161a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:00.252381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-efc197e3-5ed4-4062-8e13-8810df4f161a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:00.381571 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-efc197e3-5ed4-4062-8e13-8810df4f161a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:00.389740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-efc197e3-5ed4-4062-8e13-8810df4f161a tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1577 microversion: 2.1 time: 0.150370 Aug 02 21:53:00.390315 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 519/1063] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:00 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:00.981988 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e341b117-8033-4398-bd6d-acc48357d011 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:00.982547 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e341b117-8033-4398-bd6d-acc48357d011 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:00.992118 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e341b117-8033-4398-bd6d-acc48357d011 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:00.992708 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e341b117-8033-4398-bd6d-acc48357d011 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:00.993509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e341b117-8033-4398-bd6d-acc48357d011 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:00.994565 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e341b117-8033-4398-bd6d-acc48357d011 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:01.160287 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e341b117-8033-4398-bd6d-acc48357d011 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:01.168784 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e341b117-8033-4398-bd6d-acc48357d011 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1315 microversion: 2.1 time: 0.191770 Aug 02 21:53:01.169367 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 545/1064] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:00 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:01.410939 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-8c172627-91bf-4256-a9d1-3ac5593d37f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:01.411550 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-8c172627-91bf-4256-a9d1-3ac5593d37f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:01.419096 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8c172627-91bf-4256-a9d1-3ac5593d37f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:01.419547 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8c172627-91bf-4256-a9d1-3ac5593d37f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:01.420354 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8c172627-91bf-4256-a9d1-3ac5593d37f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:01.420791 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-8c172627-91bf-4256-a9d1-3ac5593d37f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:01.693087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-8c172627-91bf-4256-a9d1-3ac5593d37f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5377fd0bccf748dda1d0192080253dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bed6dd5430c4c9983aff2e2f261f5a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:01.701868 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-8c172627-91bf-4256-a9d1-3ac5593d37f2 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 200 len: 1577 microversion: 2.1 time: 0.294910 Aug 02 21:53:01.702449 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 520/1065] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:01 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 1577 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:01.940587 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-1d88ef1f-3cea-4415-aea0-b5ed60bffd5b req-e43e2b9f-cb45-42f6-8cdf-9b73bd0f28e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ddda1b-801a-438b-a86c-df7d1340dfba", "name": "network-vif-deleted", "tag": "65ee788b-1995-470a-8bd3-2409d32094e5"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:53:01.950558 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-1d88ef1f-3cea-4415-aea0-b5ed60bffd5b req-e43e2b9f-cb45-42f6-8cdf-9b73bd0f28e5 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:01.950995 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-1d88ef1f-3cea-4415-aea0-b5ed60bffd5b req-e43e2b9f-cb45-42f6-8cdf-9b73bd0f28e5 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:01.962371 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-1d88ef1f-3cea-4415-aea0-b5ed60bffd5b req-e43e2b9f-cb45-42f6-8cdf-9b73bd0f28e5 service nova] Creating event network-vif-deleted:65ee788b-1995-470a-8bd3-2409d32094e5 for instance 43ddda1b-801a-438b-a86c-df7d1340dfba on hv-cinder-85144 Aug 02 21:53:01.967540 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-1d88ef1f-3cea-4415-aea0-b5ed60bffd5b req-e43e2b9f-cb45-42f6-8cdf-9b73bd0f28e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030588 Aug 02 21:53:01.968126 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 546/1066] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:53:02.189713 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-85c7ffe2-90f7-48fa-8734-f1b42ca5f8d2 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:02.190256 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-85c7ffe2-90f7-48fa-8734-f1b42ca5f8d2 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:02.196390 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85c7ffe2-90f7-48fa-8734-f1b42ca5f8d2 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:02.196849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85c7ffe2-90f7-48fa-8734-f1b42ca5f8d2 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:02.197631 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85c7ffe2-90f7-48fa-8734-f1b42ca5f8d2 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:02.198076 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85c7ffe2-90f7-48fa-8734-f1b42ca5f8d2 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:02.353198 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-85c7ffe2-90f7-48fa-8734-f1b42ca5f8d2 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:02.361849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-85c7ffe2-90f7-48fa-8734-f1b42ca5f8d2 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1315 microversion: 2.1 time: 0.176019 Aug 02 21:53:02.362445 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 521/1067] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:02 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:02.725740 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:02.726583 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 43ddda1b-801a-438b-a86c-df7d1340dfba] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:02.732970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:02.733531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:02.734380 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:02.734883 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:02.750230 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] HTTP exception thrown: Instance 43ddda1b-801a-438b-a86c-df7d1340dfba could not be found. Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Request method failure captured: Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba HTTP/1.1 Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZptPXPYJJOkTdro2ctbpZWDo_p7H2ffPBrIzoqEJubOddWwfCziIes1f_134xOYicx_i06iyx32AyFYMvoveudm94WY2t7_eGdXmkPudK_cScopamekvVIcGL4SH10x34RwO3mq2XAcNwPy34fkDSmxxo7-Z-UoD3Po3uX06zjQ4mo Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:53:02.751881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 5377fd0bccf748dda1d0192080253dcf Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 43ddda1b-801a-438b-a86c-df7d1340dfba could not be found. Aug 02 21:53:02.753856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '43ddda1b-801a-438b-a86c-df7d1340dfba'} Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ddda1b-801a-438b-a86c-df7d1340dfba could not be found. Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:53:02.754840 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ddda1b-801a-438b-a86c-df7d1340dfba could not be found. Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ddda1b-801a-438b-a86c-df7d1340dfba could not be found. Aug 02 21:53:02.756493 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:02.757839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Returning 404 to user: Instance 43ddda1b-801a-438b-a86c-df7d1340dfba could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:53:02.757839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-166db2a6-3f3b-456b-80ab-d056785bc7b0 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba" status: 404 len: 111 microversion: 2.1 time: 0.032714 Aug 02 21:53:02.757839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 547/1068] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:02 2022] GET /compute/v2.1/servers/43ddda1b-801a-438b-a86c-df7d1340dfba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:53:03.203108 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:03.203622 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:03.210218 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:03.210677 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:03.211486 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:03.211931 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:03.225933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] HTTP exception thrown: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Request method failure captured: Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: DELETE /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 HTTP/1.1 Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6ZptPXPYJJOkTdro2ctbpZWDo_p7H2ffPBrIzoqEJubOddWwfCziIes1f_134xOYicx_i06iyx32AyFYMvoveudm94WY2t7_eGdXmkPudK_cScopamekvVIcGL4SH10x34RwO3mq2XAcNwPy34fkDSmxxo7-Z-UoD3Po3uX06zjQ4mo Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:53:03.227606 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 5377fd0bccf748dda1d0192080253dcf Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.229726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '5b0681fe-f330-40bb-ab1f-86772b3484e5'} Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:53:03.233732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.235192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.236691 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Returning 404 to user: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:53:03.236691 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-365cd6ab-2b36-4cf7-890d-127033c0a504 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 404 len: 111 microversion: 2.1 time: 0.030081 Aug 02 21:53:03.236691 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 522/1069] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:53:03 2022] DELETE /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:53:03.238426 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:03.239105 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] [instance: 5b0681fe-f330-40bb-ab1f-86772b3484e5] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:03.245727 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:03.246184 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:03.246958 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:03.247400 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:03.261010 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] HTTP exception thrown: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Request method failure captured: Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 HTTP/1.1 Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZptPXPYJJOkTdro2ctbpZWDo_p7H2ffPBrIzoqEJubOddWwfCziIes1f_134xOYicx_i06iyx32AyFYMvoveudm94WY2t7_eGdXmkPudK_cScopamekvVIcGL4SH10x34RwO3mq2XAcNwPy34fkDSmxxo7-Z-UoD3Po3uX06zjQ4mo Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:53:03.262663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0bed6dd5430c4c9983aff2e2f261f5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 0bed6dd5430c4c9983aff2e2f261f5a4 Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-TestVolumeBootPattern-1924611137 Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 5377fd0bccf748dda1d0192080253dcf Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-TestVolumeBootPattern-1924611137-project Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.264427 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '5b0681fe-f330-40bb-ab1f-86772b3484e5'} Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:53:03.265330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. Aug 02 21:53:03.266987 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:53:03.268353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Returning 404 to user: Instance 5b0681fe-f330-40bb-ab1f-86772b3484e5 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:53:03.268353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-54ee0f1c-5b07-41dd-9a3e-aeff25719f89 tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5" status: 404 len: 111 microversion: 2.1 time: 0.029690 Aug 02 21:53:03.268353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 548/1070] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:03 2022] GET /compute/v2.1/servers/5b0681fe-f330-40bb-ab1f-86772b3484e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:53:03.383692 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-828f1d30-34af-450c-b165-514edee9cf55 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:03.384336 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-828f1d30-34af-450c-b165-514edee9cf55 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:03.390613 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-828f1d30-34af-450c-b165-514edee9cf55 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:03.391067 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-828f1d30-34af-450c-b165-514edee9cf55 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:03.391848 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-828f1d30-34af-450c-b165-514edee9cf55 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:03.392314 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-828f1d30-34af-450c-b165-514edee9cf55 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:03.523903 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-828f1d30-34af-450c-b165-514edee9cf55 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:03.533795 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-828f1d30-34af-450c-b165-514edee9cf55 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1315 microversion: 2.1 time: 0.154170 Aug 02 21:53:03.534386 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 523/1071] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:03 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:04.555393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3919d9d9-c0b8-4338-8083-e4060223a25b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:04.556245 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3919d9d9-c0b8-4338-8083-e4060223a25b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:04.563968 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3919d9d9-c0b8-4338-8083-e4060223a25b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:04.564546 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3919d9d9-c0b8-4338-8083-e4060223a25b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:04.565592 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3919d9d9-c0b8-4338-8083-e4060223a25b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:04.566076 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3919d9d9-c0b8-4338-8083-e4060223a25b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:04.583353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-df47e3b2-019c-4f17-ad4f-a7e47586527e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] Calling method '.version_select at 0x7ff552f1d310>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:04.611451 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-df47e3b2-019c-4f17-ad4f-a7e47586527e tempest-TestVolumeBootPattern-1924611137 tempest-TestVolumeBootPattern-1924611137-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-625758165" status: 202 len: 0 microversion: 2.1 time: 0.035406 Aug 02 21:53:04.612393 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 524/1072] 10.222.0.57 () {58 vars in 1260 bytes} [Tue Aug 2 21:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-625758165 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:53:04.793422 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3919d9d9-c0b8-4338-8083-e4060223a25b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:04.815945 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3919d9d9-c0b8-4338-8083-e4060223a25b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1315 microversion: 2.1 time: 0.264481 Aug 02 21:53:04.817850 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 549/1073] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:04 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:04.866202 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-49ba6a9c-e123-4ff6-9b42-6638719384e5 req-06e94d15-68b5-4fec-9681-ee62f5e380ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8931f2b3-058f-4b08-abbe-1e42922a0d67", "name": "network-vif-plugged", "status": "completed", "tag": "f093ef18-76ea-45d9-b25e-8141939e39d2"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:53:04.882431 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-49ba6a9c-e123-4ff6-9b42-6638719384e5 req-06e94d15-68b5-4fec-9681-ee62f5e380ee service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:04.883015 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-49ba6a9c-e123-4ff6-9b42-6638719384e5 req-06e94d15-68b5-4fec-9681-ee62f5e380ee service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:04.898519 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-49ba6a9c-e123-4ff6-9b42-6638719384e5 req-06e94d15-68b5-4fec-9681-ee62f5e380ee service nova] Creating event network-vif-plugged:f093ef18-76ea-45d9-b25e-8141939e39d2 for instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 on hv-cinder-85144 Aug 02 21:53:04.906558 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-49ba6a9c-e123-4ff6-9b42-6638719384e5 req-06e94d15-68b5-4fec-9681-ee62f5e380ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044427 Aug 02 21:53:04.907183 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 525/1074] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:53:05.840631 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-0d179f11-c4af-4806-8f91-fabf25a6d10b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:05.841319 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-0d179f11-c4af-4806-8f91-fabf25a6d10b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:05.843208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:05.843879 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:05.849569 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0d179f11-c4af-4806-8f91-fabf25a6d10b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:05.850293 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0d179f11-c4af-4806-8f91-fabf25a6d10b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:05.851267 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0d179f11-c4af-4806-8f91-fabf25a6d10b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:05.851875 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-0d179f11-c4af-4806-8f91-fabf25a6d10b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:06.004648 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-0d179f11-c4af-4806-8f91-fabf25a6d10b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:06.013187 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-0d179f11-c4af-4806-8f91-fabf25a6d10b tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1315 microversion: 2.1 time: 0.176367 Aug 02 21:53:06.022786 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 550/1075] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:05 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:53:07.031280 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:07.036915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c378b83c-e74b-45a7-98f5-eabd28e3a127 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:07.037907 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c378b83c-e74b-45a7-98f5-eabd28e3a127 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:07.045620 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c378b83c-e74b-45a7-98f5-eabd28e3a127 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:07.046377 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c378b83c-e74b-45a7-98f5-eabd28e3a127 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:07.047728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c378b83c-e74b-45a7-98f5-eabd28e3a127 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:07.047728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c378b83c-e74b-45a7-98f5-eabd28e3a127 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:07.316569 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c378b83c-e74b-45a7-98f5-eabd28e3a127 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:07.334871 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c378b83c-e74b-45a7-98f5-eabd28e3a127 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1465 microversion: 2.1 time: 0.303857 Aug 02 21:53:07.335924 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 526/1076] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:07 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1465 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:07.394156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-83d0b746-fc70-4fdb-98dd-a138fe076cdd tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:07.394839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-83d0b746-fc70-4fdb-98dd-a138fe076cdd tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:07.402976 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83d0b746-fc70-4fdb-98dd-a138fe076cdd tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:07.403538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83d0b746-fc70-4fdb-98dd-a138fe076cdd tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:07.404513 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83d0b746-fc70-4fdb-98dd-a138fe076cdd tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:07.404970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-83d0b746-fc70-4fdb-98dd-a138fe076cdd tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:07.442359 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-83d0b746-fc70-4fdb-98dd-a138fe076cdd tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:53:07.557942 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-83d0b746-fc70-4fdb-98dd-a138fe076cdd tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 204 len: 0 microversion: 2.1 time: 0.172212 Aug 02 21:53:07.558921 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 551/1077] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:53:07 2022] DELETE /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:53:07.567728 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-282eee8e-e63b-49be-8cc1-fdabd5807698 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:07.568934 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-282eee8e-e63b-49be-8cc1-fdabd5807698 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:07.575847 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-282eee8e-e63b-49be-8cc1-fdabd5807698 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:07.576687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-282eee8e-e63b-49be-8cc1-fdabd5807698 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:07.577626 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-282eee8e-e63b-49be-8cc1-fdabd5807698 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:07.578339 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-282eee8e-e63b-49be-8cc1-fdabd5807698 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:07.785925 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-282eee8e-e63b-49be-8cc1-fdabd5807698 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:07.789754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:07.795375 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-282eee8e-e63b-49be-8cc1-fdabd5807698 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1471 microversion: 2.1 time: 0.231788 Aug 02 21:53:07.796267 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 527/1078] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:07 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:08.819346 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-85b65908-7b4b-4572-b155-c9f265632230 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:08.820207 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-85b65908-7b4b-4572-b155-c9f265632230 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:08.827871 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-85b65908-7b4b-4572-b155-c9f265632230 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:08.829050 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-85b65908-7b4b-4572-b155-c9f265632230 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:08.829534 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-85b65908-7b4b-4572-b155-c9f265632230 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:08.829839 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-85b65908-7b4b-4572-b155-c9f265632230 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:09.035170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-85b65908-7b4b-4572-b155-c9f265632230 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:09.043577 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-85b65908-7b4b-4572-b155-c9f265632230 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1471 microversion: 2.1 time: 0.228392 Aug 02 21:53:09.044311 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 552/1079] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:08 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:09.662161 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-b44782b1-422a-48a2-aab4-afe2ca7fc8b9 req-a43a486d-c27f-467f-8ecd-cde0dfbe9a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8931f2b3-058f-4b08-abbe-1e42922a0d67", "name": "network-vif-deleted", "tag": "f093ef18-76ea-45d9-b25e-8141939e39d2"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:53:09.684325 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-b44782b1-422a-48a2-aab4-afe2ca7fc8b9 req-a43a486d-c27f-467f-8ecd-cde0dfbe9a14 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:09.685204 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-b44782b1-422a-48a2-aab4-afe2ca7fc8b9 req-a43a486d-c27f-467f-8ecd-cde0dfbe9a14 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:09.706989 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-b44782b1-422a-48a2-aab4-afe2ca7fc8b9 req-a43a486d-c27f-467f-8ecd-cde0dfbe9a14 service nova] Creating event network-vif-deleted:f093ef18-76ea-45d9-b25e-8141939e39d2 for instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 on hv-cinder-85144 Aug 02 21:53:09.713778 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-b44782b1-422a-48a2-aab4-afe2ca7fc8b9 req-a43a486d-c27f-467f-8ecd-cde0dfbe9a14 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056256 Aug 02 21:53:09.714562 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 528/1080] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:53:10.068442 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:10.069045 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:10.078495 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:10.078981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:10.080056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:10.081156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:10.138901 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:10.139511 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:10.140265 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lazy-loading 'fault' on Instance uuid 8931f2b3-058f-4b08-abbe-1e42922a0d67 {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:53:10.227222 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1cdf68073bc425d8a552ec690aebb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5722bb5e6649349d592852f0b80219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:10.236223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9969b41a-bc49-4e51-a1e0-aed76d59c369 tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 200 len: 1305 microversion: 2.1 time: 0.172840 Aug 02 21:53:10.237294 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 553/1081] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:10 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 1305 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:53:11.267652 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:11.269334 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] [instance: 8931f2b3-058f-4b08-abbe-1e42922a0d67] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:11.282141 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:11.283132 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:11.284708 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:11.285673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:11.314040 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] HTTP exception thrown: Instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 could not be found. Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Request method failure captured: Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 HTTP/1.1 Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Zy0SaqcPC1p2yjaC-td4AGtZF3koFnDjd9WVtDzQjx21B5xmHONKjSxMz1gn310czTIytlD_Jzmjy9UZqPXV8Ea9Q9TnjBnhHvKkCaeaTGqHYdztSwsSuRAs76ka5q_skeTwxjD8Yh_Z3h6D9KOjqhHX8x_-xprTXfChwojbL9m05o Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 8c5722bb5e6649349d592852f0b80219 Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-VolumesNegativeTest-113483065 Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:53:11.317609 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c5722bb5e6649349d592852f0b80219"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8c5722bb5e6649349d592852f0b80219"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8c5722bb5e6649349d592852f0b80219"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8c5722bb5e6649349d592852f0b80219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-VolumesNegativeTest-113483065 Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 8c5722bb5e6649349d592852f0b80219 Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-VolumesNegativeTest-113483065 Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-VolumesNegativeTest-113483065-project Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: d1cdf68073bc425d8a552ec690aebb1c Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-VolumesNegativeTest-113483065-project Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 could not be found. Aug 02 21:53:11.320559 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '8931f2b3-058f-4b08-abbe-1e42922a0d67'} Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 could not be found. Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:53:11.322303 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 could not be found. Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 could not be found. Aug 02 21:53:11.325538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:53:11.329417 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] Returning 404 to user: Instance 8931f2b3-058f-4b08-abbe-1e42922a0d67 could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:53:11.331276 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bb2b0d83-f111-42d4-8889-721fb334477f tempest-VolumesNegativeTest-113483065 tempest-VolumesNegativeTest-113483065-project] 10.222.0.57 "GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67" status: 404 len: 111 microversion: 2.1 time: 0.073650 Aug 02 21:53:11.333139 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 529/1082] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:11 2022] GET /compute/v2.1/servers/8931f2b3-058f-4b08-abbe-1e42922a0d67 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:53:20.118698 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-497647277", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "networks": [{"uuid": "d67f80f5-b763-447a-9dae-edaa13896f45"}]}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:53:20.191239 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] validate_networks() for [('d67f80f5-b763-447a-9dae-edaa13896f45', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:53:20.232425 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:20.625448 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:53:20.625886 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:53:20.626370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:53:20.626843 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:53:20.627268 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:53:20.636900 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:20.637353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:20.638731 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:20.639178 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:20.663497 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Getting quotas for project 7191ff82ccdb4ed78b592fc6f01bf9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:53:20.668074 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Getting quotas for user 2557b90bba5c41be864a92fc49484a3c and project 7191ff82ccdb4ed78b592fc6f01bf9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:53:20.679576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:53:20.681898 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:53:20.736905 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-438acd3d-2aea-4f77-bfba-4ddea4afe7ea tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621969 Aug 02 21:53:20.744641 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 554/1083] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:53:20.750810 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-a4995837-25b4-4675-8370-9ccf005a3b08 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:20.751531 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-a4995837-25b4-4675-8370-9ccf005a3b08 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:20.824636 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-a4995837-25b4-4675-8370-9ccf005a3b08 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:20.836727 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-a4995837-25b4-4675-8370-9ccf005a3b08 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1218 microversion: 2.1 time: 0.090028 Aug 02 21:53:20.837473 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 530/1084] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:20 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:21.870358 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-850aff49-ae11-4db7-b66b-8455a97cbea5 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:21.871644 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-850aff49-ae11-4db7-b66b-8455a97cbea5 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:21.879248 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-850aff49-ae11-4db7-b66b-8455a97cbea5 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:21.880086 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-850aff49-ae11-4db7-b66b-8455a97cbea5 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:21.881135 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-850aff49-ae11-4db7-b66b-8455a97cbea5 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:21.882006 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-850aff49-ae11-4db7-b66b-8455a97cbea5 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:21.955304 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-850aff49-ae11-4db7-b66b-8455a97cbea5 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:21.963370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-850aff49-ae11-4db7-b66b-8455a97cbea5 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1288 microversion: 2.1 time: 0.097300 Aug 02 21:53:21.964057 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 555/1085] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:21 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:22.987371 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-60bfb289-a7fd-480e-822a-bda1f172b350 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:22.988002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-60bfb289-a7fd-480e-822a-bda1f172b350 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:22.991169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=4 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:22.992765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:22.999610 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-60bfb289-a7fd-480e-822a-bda1f172b350 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:22.999940 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-60bfb289-a7fd-480e-822a-bda1f172b350 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:23.000802 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-60bfb289-a7fd-480e-822a-bda1f172b350 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:23.001271 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-60bfb289-a7fd-480e-822a-bda1f172b350 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:23.180674 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-60bfb289-a7fd-480e-822a-bda1f172b350 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:23.189314 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-60bfb289-a7fd-480e-822a-bda1f172b350 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1318 microversion: 2.1 time: 0.207145 Aug 02 21:53:23.189928 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 531/1086] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:22 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:53:23.271756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-910820a2-7691-4b92-868e-5ed6218f196c req-b65eb22c-288b-4bb5-974a-651f1cc990da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d786252c-9dc6-4bb9-8279-99ead46a6e48", "tag": "52268e41-741e-4d91-ad97-f7884ddc3baf"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:53:23.281539 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:23.295275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-910820a2-7691-4b92-868e-5ed6218f196c req-b65eb22c-288b-4bb5-974a-651f1cc990da service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:23.296031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-910820a2-7691-4b92-868e-5ed6218f196c req-b65eb22c-288b-4bb5-974a-651f1cc990da service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:23.322440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-910820a2-7691-4b92-868e-5ed6218f196c req-b65eb22c-288b-4bb5-974a-651f1cc990da service nova] Creating event network-changed:52268e41-741e-4d91-ad97-f7884ddc3baf for instance d786252c-9dc6-4bb9-8279-99ead46a6e48 on hv-cinder-85144 Aug 02 21:53:23.331670 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-910820a2-7691-4b92-868e-5ed6218f196c req-b65eb22c-288b-4bb5-974a-651f1cc990da service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065885 Aug 02 21:53:23.333453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 556/1087] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:53:24.212972 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-85578ed8-e217-4960-b4c7-7e7fca4a866d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:24.213595 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-85578ed8-e217-4960-b4c7-7e7fca4a866d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:24.220830 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85578ed8-e217-4960-b4c7-7e7fca4a866d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:24.221279 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85578ed8-e217-4960-b4c7-7e7fca4a866d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:24.222047 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85578ed8-e217-4960-b4c7-7e7fca4a866d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:24.222480 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-85578ed8-e217-4960-b4c7-7e7fca4a866d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:24.373307 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-85578ed8-e217-4960-b4c7-7e7fca4a866d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:24.381352 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-85578ed8-e217-4960-b4c7-7e7fca4a866d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1318 microversion: 2.1 time: 0.172552 Aug 02 21:53:24.381933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 532/1088] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:24 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:25.410644 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8b86ad02-11c8-492e-ad6a-f6fccfe8cb8d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:25.411352 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8b86ad02-11c8-492e-ad6a-f6fccfe8cb8d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:25.418090 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8b86ad02-11c8-492e-ad6a-f6fccfe8cb8d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:25.419020 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8b86ad02-11c8-492e-ad6a-f6fccfe8cb8d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:25.419804 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8b86ad02-11c8-492e-ad6a-f6fccfe8cb8d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:25.420261 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8b86ad02-11c8-492e-ad6a-f6fccfe8cb8d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:25.563047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8b86ad02-11c8-492e-ad6a-f6fccfe8cb8d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:25.570648 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8b86ad02-11c8-492e-ad6a-f6fccfe8cb8d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1318 microversion: 2.1 time: 0.164154 Aug 02 21:53:25.571223 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 557/1089] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:25 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:26.590971 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-40da6765-2e18-403e-8132-39485beff20a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:26.591590 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-40da6765-2e18-403e-8132-39485beff20a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:26.598158 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-40da6765-2e18-403e-8132-39485beff20a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:26.598722 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-40da6765-2e18-403e-8132-39485beff20a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:26.599494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-40da6765-2e18-403e-8132-39485beff20a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:26.599933 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-40da6765-2e18-403e-8132-39485beff20a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:26.737566 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-40da6765-2e18-403e-8132-39485beff20a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:26.745157 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-40da6765-2e18-403e-8132-39485beff20a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1318 microversion: 2.1 time: 0.158087 Aug 02 21:53:26.745991 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 533/1090] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:26 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:27.767680 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-2b38c664-0289-4524-9b7e-5f177964a63b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:27.768478 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-2b38c664-0289-4524-9b7e-5f177964a63b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:27.775970 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2b38c664-0289-4524-9b7e-5f177964a63b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:27.776441 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2b38c664-0289-4524-9b7e-5f177964a63b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:27.777215 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2b38c664-0289-4524-9b7e-5f177964a63b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:27.777651 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-2b38c664-0289-4524-9b7e-5f177964a63b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:27.909940 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-2b38c664-0289-4524-9b7e-5f177964a63b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:27.917490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-2b38c664-0289-4524-9b7e-5f177964a63b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1318 microversion: 2.1 time: 0.154683 Aug 02 21:53:27.918056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 558/1091] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:27 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:28.849993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-a8be86e3-5fe7-4def-a9f2-ce5663f14016 req-65ddc07a-db26-4be9-8437-67e2663528de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d786252c-9dc6-4bb9-8279-99ead46a6e48", "name": "network-vif-plugged", "status": "completed", "tag": "52268e41-741e-4d91-ad97-f7884ddc3baf"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:53:28.865430 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-a8be86e3-5fe7-4def-a9f2-ce5663f14016 req-65ddc07a-db26-4be9-8437-67e2663528de service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:28.865928 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-a8be86e3-5fe7-4def-a9f2-ce5663f14016 req-65ddc07a-db26-4be9-8437-67e2663528de service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:28.878809 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-a8be86e3-5fe7-4def-a9f2-ce5663f14016 req-65ddc07a-db26-4be9-8437-67e2663528de service nova] Creating event network-vif-plugged:52268e41-741e-4d91-ad97-f7884ddc3baf for instance d786252c-9dc6-4bb9-8279-99ead46a6e48 on hv-cinder-85144 Aug 02 21:53:28.884049 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-a8be86e3-5fe7-4def-a9f2-ce5663f14016 req-65ddc07a-db26-4be9-8437-67e2663528de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039864 Aug 02 21:53:28.884892 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 534/1092] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:53:28.944787 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6118b6d2-04a7-4afc-a684-e08a363094e9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:28.945490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6118b6d2-04a7-4afc-a684-e08a363094e9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:28.954849 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6118b6d2-04a7-4afc-a684-e08a363094e9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:28.955534 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6118b6d2-04a7-4afc-a684-e08a363094e9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:28.956944 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6118b6d2-04a7-4afc-a684-e08a363094e9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:28.957595 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6118b6d2-04a7-4afc-a684-e08a363094e9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:29.148208 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6118b6d2-04a7-4afc-a684-e08a363094e9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:29.159417 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6118b6d2-04a7-4afc-a684-e08a363094e9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1318 microversion: 2.1 time: 0.220625 Aug 02 21:53:29.160193 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 559/1093] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:28 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:53:30.183912 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-34691b94-a351-482e-947e-043217e79494 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:30.184836 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-34691b94-a351-482e-947e-043217e79494 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:30.191695 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-34691b94-a351-482e-947e-043217e79494 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:30.192164 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-34691b94-a351-482e-947e-043217e79494 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:30.192962 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-34691b94-a351-482e-947e-043217e79494 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:30.193388 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-34691b94-a351-482e-947e-043217e79494 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:30.343207 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-34691b94-a351-482e-947e-043217e79494 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:30.353654 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-34691b94-a351-482e-947e-043217e79494 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1318 microversion: 2.1 time: 0.174404 Aug 02 21:53:30.354320 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 535/1094] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:30 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:53:31.379690 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-868e65f3-093c-4dd2-b8d5-b94d32e35bfd tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:53:31.380342 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-868e65f3-093c-4dd2-b8d5-b94d32e35bfd tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:31.382732 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:31.383424 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:31.389325 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-868e65f3-093c-4dd2-b8d5-b94d32e35bfd tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:31.389781 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-868e65f3-093c-4dd2-b8d5-b94d32e35bfd tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:31.390575 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-868e65f3-093c-4dd2-b8d5-b94d32e35bfd tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:31.391031 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-868e65f3-093c-4dd2-b8d5-b94d32e35bfd tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:31.529858 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-868e65f3-093c-4dd2-b8d5-b94d32e35bfd tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:53:31.539125 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-868e65f3-093c-4dd2-b8d5-b94d32e35bfd tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1508 microversion: 2.1 time: 0.163068 Aug 02 21:53:31.539939 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 560/1095] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:53:31 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:53:53.180087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-1bc9899d-0c55-48aa-b580-f0d6067bd089 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "184a5424-14ea-435e-b7ee-38e2af92d28e", "device": "/dev/sdb"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:53:53.183040 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-1bc9899d-0c55-48aa-b580-f0d6067bd089 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:53:53.185227 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:53.185937 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=9 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:53.186550 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=26 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:53.192704 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1bc9899d-0c55-48aa-b580-f0d6067bd089 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:53.193156 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1bc9899d-0c55-48aa-b580-f0d6067bd089 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:53.193921 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1bc9899d-0c55-48aa-b580-f0d6067bd089 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:53:53.194385 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-1bc9899d-0c55-48aa-b580-f0d6067bd089 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:53:53.473309 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-1bc9899d-0c55-48aa-b580-f0d6067bd089 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "POST /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297008 Aug 02 21:53:53.474072 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 536/1096] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:53:53 2022] POST /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:54:20.326023 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c90aad49-ac34-43e1-af82-ca1459088c90 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:20.326541 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c90aad49-ac34-43e1-af82-ca1459088c90 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:20.328663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=9 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:20.329548 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=34 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:20.335813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c90aad49-ac34-43e1-af82-ca1459088c90 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:20.336319 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c90aad49-ac34-43e1-af82-ca1459088c90 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:20.337118 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c90aad49-ac34-43e1-af82-ca1459088c90 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:20.337567 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c90aad49-ac34-43e1-af82-ca1459088c90 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:20.422168 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.objects.instance [None req-c90aad49-ac34-43e1-af82-ca1459088c90 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lazy-loading 'services' on Instance uuid d786252c-9dc6-4bb9-8279-99ead46a6e48 {{(pid=124839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:54:20.496597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c90aad49-ac34-43e1-af82-ca1459088c90 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48/os-volume_attachments/184a5424-14ea-435e-b7ee-38e2af92d28e" status: 202 len: 0 microversion: 2.1 time: 0.174284 Aug 02 21:54:20.497202 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 561/1097] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:54:20 2022] DELETE /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48/os-volume_attachments/184a5424-14ea-435e-b7ee-38e2af92d28e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:54:21.619915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-59de3e90-6d27-4620-afb2-8c5493b26ab8 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:21.620542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-59de3e90-6d27-4620-afb2-8c5493b26ab8 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:21.623048 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:21.623735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:21.630129 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-59de3e90-6d27-4620-afb2-8c5493b26ab8 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:21.630592 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-59de3e90-6d27-4620-afb2-8c5493b26ab8 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:21.631380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-59de3e90-6d27-4620-afb2-8c5493b26ab8 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:21.631825 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-59de3e90-6d27-4620-afb2-8c5493b26ab8 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:21.658965 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-59de3e90-6d27-4620-afb2-8c5493b26ab8 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:54:21.745915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-59de3e90-6d27-4620-afb2-8c5493b26ab8 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 204 len: 0 microversion: 2.1 time: 0.129882 Aug 02 21:54:21.746593 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 537/1098] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:54:21 2022] DELETE /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:54:21.756407 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-92d77906-74d9-45cc-b572-9caa7283054d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:21.757207 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-92d77906-74d9-45cc-b572-9caa7283054d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:21.764296 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92d77906-74d9-45cc-b572-9caa7283054d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:21.764756 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92d77906-74d9-45cc-b572-9caa7283054d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:21.765550 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92d77906-74d9-45cc-b572-9caa7283054d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:21.765994 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-92d77906-74d9-45cc-b572-9caa7283054d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:21.905357 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-92d77906-74d9-45cc-b572-9caa7283054d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:21.913473 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-92d77906-74d9-45cc-b572-9caa7283054d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1514 microversion: 2.1 time: 0.162195 Aug 02 21:54:21.914047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 562/1099] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:21 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:22.936723 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-59dc02df-92a2-43d1-9f5c-cdcbbdbc980d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:22.937423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-59dc02df-92a2-43d1-9f5c-cdcbbdbc980d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:22.943881 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-59dc02df-92a2-43d1-9f5c-cdcbbdbc980d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:22.944375 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-59dc02df-92a2-43d1-9f5c-cdcbbdbc980d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:22.945140 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-59dc02df-92a2-43d1-9f5c-cdcbbdbc980d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:22.945573 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-59dc02df-92a2-43d1-9f5c-cdcbbdbc980d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:23.083477 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-59dc02df-92a2-43d1-9f5c-cdcbbdbc980d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:23.091862 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-59dc02df-92a2-43d1-9f5c-cdcbbdbc980d tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1514 microversion: 2.1 time: 0.160024 Aug 02 21:54:23.092479 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 538/1100] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:22 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:24.115510 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-e543e503-ce0e-470e-b29a-2c725863a26b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:24.116321 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-e543e503-ce0e-470e-b29a-2c725863a26b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:24.125627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e543e503-ce0e-470e-b29a-2c725863a26b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:24.126297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e543e503-ce0e-470e-b29a-2c725863a26b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:24.127597 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e543e503-ce0e-470e-b29a-2c725863a26b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:24.128459 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-e543e503-ce0e-470e-b29a-2c725863a26b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:24.297981 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-e543e503-ce0e-470e-b29a-2c725863a26b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:24.309224 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-e543e503-ce0e-470e-b29a-2c725863a26b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 200 len: 1514 microversion: 2.1 time: 0.198941 Aug 02 21:54:24.309861 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 563/1101] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:24 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:24.334779 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-ef0f0561-a3a9-478a-bada-2b08a1eee4a4 req-5fdf5209-33c9-470f-a619-7757534f519b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d786252c-9dc6-4bb9-8279-99ead46a6e48", "name": "network-vif-deleted", "tag": "52268e41-741e-4d91-ad97-f7884ddc3baf"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:54:24.346110 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-ef0f0561-a3a9-478a-bada-2b08a1eee4a4 req-5fdf5209-33c9-470f-a619-7757534f519b service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:24.346549 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-ef0f0561-a3a9-478a-bada-2b08a1eee4a4 req-5fdf5209-33c9-470f-a619-7757534f519b service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:24.359001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-ef0f0561-a3a9-478a-bada-2b08a1eee4a4 req-5fdf5209-33c9-470f-a619-7757534f519b service nova] Creating event network-vif-deleted:52268e41-741e-4d91-ad97-f7884ddc3baf for instance d786252c-9dc6-4bb9-8279-99ead46a6e48 on hv-cinder-85144 Aug 02 21:54:24.365283 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-ef0f0561-a3a9-478a-bada-2b08a1eee4a4 req-5fdf5209-33c9-470f-a619-7757534f519b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034052 Aug 02 21:54:24.366087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 539/1102] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:54:25.330397 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:25.331010 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: d786252c-9dc6-4bb9-8279-99ead46a6e48] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:25.337883 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:25.338894 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:25.339722 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:25.340211 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:25.353881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] HTTP exception thrown: Instance d786252c-9dc6-4bb9-8279-99ead46a6e48 could not be found. Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Request method failure captured: Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 HTTP/1.1 Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZzOz5f1SkAdbbF_BvIINAuiaFH3YTK1IYogj5qp7jftzX_QWfb-y8D9deBdTv20sEeIh_s2k1456ngSi4_jGqq7G985zF_K0uH-mfvFd90LQYb0Jm4ijSxDNCP9Zs_AYhYSFI13SbkJAyXoSl9sWWoJzoUJxO4Sn6njAs1Ugr7TPss Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 7191ff82ccdb4ed78b592fc6f01bf9d3 Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesSnapshotTestJSON-304085012 Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:54:25.355622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7191ff82ccdb4ed78b592fc6f01bf9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7191ff82ccdb4ed78b592fc6f01bf9d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7191ff82ccdb4ed78b592fc6f01bf9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7191ff82ccdb4ed78b592fc6f01bf9d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesSnapshotTestJSON-304085012 Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 7191ff82ccdb4ed78b592fc6f01bf9d3 Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-304085012 Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesSnapshotTestJSON-304085012-project Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 2557b90bba5c41be864a92fc49484a3c Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesSnapshotTestJSON-304085012-project Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance d786252c-9dc6-4bb9-8279-99ead46a6e48 could not be found. Aug 02 21:54:25.357302 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': 'd786252c-9dc6-4bb9-8279-99ead46a6e48'} Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d786252c-9dc6-4bb9-8279-99ead46a6e48 could not be found. Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:54:25.358290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d786252c-9dc6-4bb9-8279-99ead46a6e48 could not be found. Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d786252c-9dc6-4bb9-8279-99ead46a6e48 could not be found. Aug 02 21:54:25.359813 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:54:25.361622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Returning 404 to user: Instance d786252c-9dc6-4bb9-8279-99ead46a6e48 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:54:25.361622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3bba75de-4a65-42ab-9f79-f3a76c84cef0 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48" status: 404 len: 111 microversion: 2.1 time: 0.030703 Aug 02 21:54:25.361622 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 564/1103] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:25 2022] GET /compute/v2.1/servers/d786252c-9dc6-4bb9-8279-99ead46a6e48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:54:35.254574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:35.255312 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:35.259423 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1583678616", "imageRef": "e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25", "flavorRef": "452", "networks": [{"uuid": "d67f80f5-b763-447a-9dae-edaa13896f45"}]}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:54:35.313613 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.network.neutron [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] validate_networks() for [('d67f80f5-b763-447a-9dae-edaa13896f45', None, None, None, None, None)] {{(pid=124840) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:54:35.687327 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Flavor limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:54:35.687814 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Image limits 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:54:35.688702 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Flavor pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:54:35.689443 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Image pref 0:0:0 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:54:35.689942 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.virt.hardware [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:54:35.700260 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:35.700624 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:35.701438 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:35.701877 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:35.719878 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Getting quotas for project 7191ff82ccdb4ed78b592fc6f01bf9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:54:35.725046 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Getting quotas for user 2557b90bba5c41be864a92fc49484a3c and project 7191ff82ccdb4ed78b592fc6f01bf9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:54:35.742426 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Going to run 1 instances... {{(pid=124840) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:54:35.746320 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4ca7bf4-ad05-4bd8-bbeb-adc1adda5b25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:54:35.797548 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-d8383277-26c2-4f7e-adf4-bce2f33edfe9 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544400 Aug 02 21:54:35.798381 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 540/1104] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 21:54:35.811365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-05c86221-d499-47fa-a953-daaf0d09123f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:35.811976 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-05c86221-d499-47fa-a953-daaf0d09123f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:35.814627 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=8 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:35.815532 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:35.878681 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-05c86221-d499-47fa-a953-daaf0d09123f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:35.885872 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-05c86221-d499-47fa-a953-daaf0d09123f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1219 microversion: 2.1 time: 0.078896 Aug 02 21:54:35.886451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 565/1105] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:35 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:36.910253 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-98d85550-043e-4e13-98c8-a1955b8a2ad1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:36.911233 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-98d85550-043e-4e13-98c8-a1955b8a2ad1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:36.919672 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-98d85550-043e-4e13-98c8-a1955b8a2ad1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:36.920121 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-98d85550-043e-4e13-98c8-a1955b8a2ad1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:36.920997 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-98d85550-043e-4e13-98c8-a1955b8a2ad1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:36.921486 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-98d85550-043e-4e13-98c8-a1955b8a2ad1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:37.042846 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-98d85550-043e-4e13-98c8-a1955b8a2ad1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:37.051145 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-98d85550-043e-4e13-98c8-a1955b8a2ad1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1279 microversion: 2.1 time: 0.146786 Aug 02 21:54:37.051769 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 541/1106] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:36 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:38.075555 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-037c6851-c7e9-4574-a757-648769bc64fb tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:38.076431 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-037c6851-c7e9-4574-a757-648769bc64fb tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:38.083682 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-037c6851-c7e9-4574-a757-648769bc64fb tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:38.084144 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-037c6851-c7e9-4574-a757-648769bc64fb tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:38.084923 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-037c6851-c7e9-4574-a757-648769bc64fb tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:38.085365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-037c6851-c7e9-4574-a757-648769bc64fb tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:38.234421 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-037c6851-c7e9-4574-a757-648769bc64fb tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:38.242902 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-037c6851-c7e9-4574-a757-648769bc64fb tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1319 microversion: 2.1 time: 0.171576 Aug 02 21:54:38.243566 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 566/1107] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:38 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:38.364913 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-2da2d968-de11-4919-ba0c-753a1325e76b req-257813b7-000a-48c9-a9da-f41ac332b135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a45214-041c-468c-858f-1a87859ecf20", "tag": "f26be1b1-f89b-4ad1-a594-75ab2eb8880b"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:54:38.382468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-2da2d968-de11-4919-ba0c-753a1325e76b req-257813b7-000a-48c9-a9da-f41ac332b135 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:38.383262 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-2da2d968-de11-4919-ba0c-753a1325e76b req-257813b7-000a-48c9-a9da-f41ac332b135 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:38.398163 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-2da2d968-de11-4919-ba0c-753a1325e76b req-257813b7-000a-48c9-a9da-f41ac332b135 service nova] Creating event network-changed:f26be1b1-f89b-4ad1-a594-75ab2eb8880b for instance 58a45214-041c-468c-858f-1a87859ecf20 on hv-cinder-85144 Aug 02 21:54:38.403421 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-2da2d968-de11-4919-ba0c-753a1325e76b req-257813b7-000a-48c9-a9da-f41ac332b135 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042593 Aug 02 21:54:38.404030 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 542/1108] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:54:39.265361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-6b7624da-4d62-4884-b172-9856617fb894 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:39.266107 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-6b7624da-4d62-4884-b172-9856617fb894 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:39.273215 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b7624da-4d62-4884-b172-9856617fb894 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:39.273712 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b7624da-4d62-4884-b172-9856617fb894 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:39.274583 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b7624da-4d62-4884-b172-9856617fb894 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:39.275086 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-6b7624da-4d62-4884-b172-9856617fb894 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:39.435245 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-6b7624da-4d62-4884-b172-9856617fb894 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:39.444606 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-6b7624da-4d62-4884-b172-9856617fb894 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1319 microversion: 2.1 time: 0.183026 Aug 02 21:54:39.445209 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 567/1109] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:39 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:40.467582 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-235ac7e1-64ad-4686-837f-6cd331baad51 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:40.468219 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-235ac7e1-64ad-4686-837f-6cd331baad51 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:40.474527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-235ac7e1-64ad-4686-837f-6cd331baad51 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:40.475010 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-235ac7e1-64ad-4686-837f-6cd331baad51 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:40.475776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-235ac7e1-64ad-4686-837f-6cd331baad51 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:40.476230 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-235ac7e1-64ad-4686-837f-6cd331baad51 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:40.625369 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-235ac7e1-64ad-4686-837f-6cd331baad51 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:40.635397 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-235ac7e1-64ad-4686-837f-6cd331baad51 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1319 microversion: 2.1 time: 0.172085 Aug 02 21:54:40.636105 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 543/1110] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:40 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:41.659122 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a63fec54-1e97-41a1-8188-5edea6e69ebe tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:41.659677 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a63fec54-1e97-41a1-8188-5edea6e69ebe tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:41.667440 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a63fec54-1e97-41a1-8188-5edea6e69ebe tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:41.667957 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a63fec54-1e97-41a1-8188-5edea6e69ebe tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:41.668895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a63fec54-1e97-41a1-8188-5edea6e69ebe tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:41.669407 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a63fec54-1e97-41a1-8188-5edea6e69ebe tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:41.809132 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a63fec54-1e97-41a1-8188-5edea6e69ebe tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:41.817911 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a63fec54-1e97-41a1-8188-5edea6e69ebe tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1319 microversion: 2.1 time: 0.163502 Aug 02 21:54:41.818549 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 568/1111] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:41 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:42.840521 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c2da8d18-e395-4c49-aa39-66dbf35ae860 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:42.841173 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c2da8d18-e395-4c49-aa39-66dbf35ae860 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:42.848300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c2da8d18-e395-4c49-aa39-66dbf35ae860 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:42.848729 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c2da8d18-e395-4c49-aa39-66dbf35ae860 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:42.849790 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c2da8d18-e395-4c49-aa39-66dbf35ae860 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:42.850232 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c2da8d18-e395-4c49-aa39-66dbf35ae860 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:42.998212 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c2da8d18-e395-4c49-aa39-66dbf35ae860 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:43.008642 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c2da8d18-e395-4c49-aa39-66dbf35ae860 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1319 microversion: 2.1 time: 0.171571 Aug 02 21:54:43.009488 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 544/1112] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:42 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:44.035509 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-40edb604-84f9-496e-bb51-78a966d3758c tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:44.036195 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-40edb604-84f9-496e-bb51-78a966d3758c tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:44.042888 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-40edb604-84f9-496e-bb51-78a966d3758c tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:44.043341 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-40edb604-84f9-496e-bb51-78a966d3758c tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:44.044119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-40edb604-84f9-496e-bb51-78a966d3758c tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:44.044573 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-40edb604-84f9-496e-bb51-78a966d3758c tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:44.188357 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-40edb604-84f9-496e-bb51-78a966d3758c tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:44.196743 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-40edb604-84f9-496e-bb51-78a966d3758c tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1319 microversion: 2.1 time: 0.165326 Aug 02 21:54:44.197979 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 569/1113] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:44 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:45.224468 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2b0f3353-b4b7-4d53-986c-b49cab35cd4f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:45.225764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2b0f3353-b4b7-4d53-986c-b49cab35cd4f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:45.239292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2b0f3353-b4b7-4d53-986c-b49cab35cd4f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:45.239986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2b0f3353-b4b7-4d53-986c-b49cab35cd4f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:45.241309 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2b0f3353-b4b7-4d53-986c-b49cab35cd4f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:45.241998 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2b0f3353-b4b7-4d53-986c-b49cab35cd4f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:45.314146 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-7c3de5c4-d181-4206-903c-7d5a7bc2076c req-98a20b54-c5cc-4a3e-93dd-92d50c6141c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a45214-041c-468c-858f-1a87859ecf20", "name": "network-vif-plugged", "status": "completed", "tag": "f26be1b1-f89b-4ad1-a594-75ab2eb8880b"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:54:45.336009 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7c3de5c4-d181-4206-903c-7d5a7bc2076c req-98a20b54-c5cc-4a3e-93dd-92d50c6141c6 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:45.337347 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-7c3de5c4-d181-4206-903c-7d5a7bc2076c req-98a20b54-c5cc-4a3e-93dd-92d50c6141c6 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:45.351266 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-7c3de5c4-d181-4206-903c-7d5a7bc2076c req-98a20b54-c5cc-4a3e-93dd-92d50c6141c6 service nova] Creating event network-vif-plugged:f26be1b1-f89b-4ad1-a594-75ab2eb8880b for instance 58a45214-041c-468c-858f-1a87859ecf20 on hv-cinder-85144 Aug 02 21:54:45.358807 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-7c3de5c4-d181-4206-903c-7d5a7bc2076c req-98a20b54-c5cc-4a3e-93dd-92d50c6141c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051312 Aug 02 21:54:45.359895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 570/1114] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:54:45.420687 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2b0f3353-b4b7-4d53-986c-b49cab35cd4f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:45.429574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2b0f3353-b4b7-4d53-986c-b49cab35cd4f tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1319 microversion: 2.1 time: 0.213617 Aug 02 21:54:45.430161 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 545/1115] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:45 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:46.448678 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:46.454571 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-10082a16-4067-404c-b446-cc7122981b8a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:46.455301 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-10082a16-4067-404c-b446-cc7122981b8a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:46.462275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-10082a16-4067-404c-b446-cc7122981b8a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:46.462808 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-10082a16-4067-404c-b446-cc7122981b8a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:46.464100 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-10082a16-4067-404c-b446-cc7122981b8a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:46.464578 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-10082a16-4067-404c-b446-cc7122981b8a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:46.606407 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-10082a16-4067-404c-b446-cc7122981b8a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:46.614386 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-10082a16-4067-404c-b446-cc7122981b8a tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1319 microversion: 2.1 time: 0.166754 Aug 02 21:54:46.614949 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 571/1116] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:46 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:47.637458 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2b67d2ad-6f03-4242-a8fb-6a33c00fb9e6 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:54:47.638497 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2b67d2ad-6f03-4242-a8fb-6a33c00fb9e6 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:47.641842 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:47.642969 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=6 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:47.652574 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2b67d2ad-6f03-4242-a8fb-6a33c00fb9e6 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:47.653022 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2b67d2ad-6f03-4242-a8fb-6a33c00fb9e6 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:47.653799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2b67d2ad-6f03-4242-a8fb-6a33c00fb9e6 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:47.654232 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2b67d2ad-6f03-4242-a8fb-6a33c00fb9e6 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:47.813138 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2b67d2ad-6f03-4242-a8fb-6a33c00fb9e6 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:54:47.823787 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2b67d2ad-6f03-4242-a8fb-6a33c00fb9e6 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1509 microversion: 2.1 time: 0.191529 Aug 02 21:54:47.824436 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 546/1117] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:54:47 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:54:47.845247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-fa852444-9205-450e-bfce-a84644abb70b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6e6cf95-0aaf-4d5f-b4ea-c0ffcdba98bb", "device": "/dev/sdb"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:54:47.848525 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-fa852444-9205-450e-bfce-a84644abb70b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:54:47.855670 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fa852444-9205-450e-bfce-a84644abb70b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:47.856150 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fa852444-9205-450e-bfce-a84644abb70b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:47.856958 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fa852444-9205-450e-bfce-a84644abb70b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:54:47.857403 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-fa852444-9205-450e-bfce-a84644abb70b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:54:48.153118 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-fa852444-9205-450e-bfce-a84644abb70b tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "POST /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311707 Aug 02 21:54:48.153974 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 572/1118] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:54:47 2022] POST /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:55:09.626057 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9f31c726-16c6-49b4-91b2-c3abfc1a50ad tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:55:09.626661 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9f31c726-16c6-49b4-91b2-c3abfc1a50ad tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:55:09.629254 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:09.630024 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=34 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:09.636653 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9f31c726-16c6-49b4-91b2-c3abfc1a50ad tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:09.637099 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9f31c726-16c6-49b4-91b2-c3abfc1a50ad tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:09.637870 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9f31c726-16c6-49b4-91b2-c3abfc1a50ad tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:09.638318 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9f31c726-16c6-49b4-91b2-c3abfc1a50ad tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:09.832494 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-9f31c726-16c6-49b4-91b2-c3abfc1a50ad tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lazy-loading 'services' on Instance uuid 58a45214-041c-468c-858f-1a87859ecf20 {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:55:09.907905 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9f31c726-16c6-49b4-91b2-c3abfc1a50ad tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "DELETE /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20/os-volume_attachments/c6e6cf95-0aaf-4d5f-b4ea-c0ffcdba98bb" status: 202 len: 0 microversion: 2.1 time: 0.285675 Aug 02 21:55:09.909036 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 547/1119] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:55:09 2022] DELETE /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20/os-volume_attachments/c6e6cf95-0aaf-4d5f-b4ea-c0ffcdba98bb => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:55:11.043796 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=18 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:11.044663 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:11.049284 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3a08afc7-1021-48ce-a080-2c2ed563bff1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:55:11.049881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3a08afc7-1021-48ce-a080-2c2ed563bff1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:55:11.058290 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3a08afc7-1021-48ce-a080-2c2ed563bff1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:11.058684 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3a08afc7-1021-48ce-a080-2c2ed563bff1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:11.059470 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3a08afc7-1021-48ce-a080-2c2ed563bff1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:11.059913 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3a08afc7-1021-48ce-a080-2c2ed563bff1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:11.086878 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3a08afc7-1021-48ce-a080-2c2ed563bff1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Going to try to terminate instance {{(pid=124839) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:55:11.167542 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3a08afc7-1021-48ce-a080-2c2ed563bff1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "DELETE /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 204 len: 0 microversion: 2.1 time: 0.125071 Aug 02 21:55:11.168229 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 573/1120] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:55:11 2022] DELETE /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 21:55:11.178170 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-faf414f5-00ac-4d50-b8a1-7266d5bebf71 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:55:11.179564 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-faf414f5-00ac-4d50-b8a1-7266d5bebf71 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:55:11.186330 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-faf414f5-00ac-4d50-b8a1-7266d5bebf71 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:11.186839 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-faf414f5-00ac-4d50-b8a1-7266d5bebf71 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:11.187613 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-faf414f5-00ac-4d50-b8a1-7266d5bebf71 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:11.188054 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-faf414f5-00ac-4d50-b8a1-7266d5bebf71 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:11.320587 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-faf414f5-00ac-4d50-b8a1-7266d5bebf71 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:55:11.328740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-faf414f5-00ac-4d50-b8a1-7266d5bebf71 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1515 microversion: 2.1 time: 0.155831 Aug 02 21:55:11.329391 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 548/1121] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:55:11 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:55:12.351809 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-9e8b3838-49e6-4b03-b234-314ec6be4399 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:55:12.352604 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-9e8b3838-49e6-4b03-b234-314ec6be4399 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:55:12.359437 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9e8b3838-49e6-4b03-b234-314ec6be4399 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:12.359894 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9e8b3838-49e6-4b03-b234-314ec6be4399 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:12.360711 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9e8b3838-49e6-4b03-b234-314ec6be4399 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:12.361155 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-9e8b3838-49e6-4b03-b234-314ec6be4399 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:12.546109 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-9e8b3838-49e6-4b03-b234-314ec6be4399 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:55:12.553783 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-9e8b3838-49e6-4b03-b234-314ec6be4399 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1515 microversion: 2.1 time: 0.206212 Aug 02 21:55:12.554356 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 574/1122] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:55:12 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:55:13.577403 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bb3ffac4-0ec9-478a-b1ba-32722b30b3e3 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:55:13.578326 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bb3ffac4-0ec9-478a-b1ba-32722b30b3e3 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:55:13.585219 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb3ffac4-0ec9-478a-b1ba-32722b30b3e3 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:13.585685 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb3ffac4-0ec9-478a-b1ba-32722b30b3e3 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:13.586477 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb3ffac4-0ec9-478a-b1ba-32722b30b3e3 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:13.586993 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bb3ffac4-0ec9-478a-b1ba-32722b30b3e3 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:13.598460 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-01c85ef6-8fe6-42aa-a5f8-1f1b156ca4a5 req-a0a5fd71-101d-40b0-bf03-361505289f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a45214-041c-468c-858f-1a87859ecf20", "name": "network-vif-deleted", "tag": "f26be1b1-f89b-4ad1-a594-75ab2eb8880b"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:55:13.609416 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-01c85ef6-8fe6-42aa-a5f8-1f1b156ca4a5 req-a0a5fd71-101d-40b0-bf03-361505289f15 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:13.609861 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-01c85ef6-8fe6-42aa-a5f8-1f1b156ca4a5 req-a0a5fd71-101d-40b0-bf03-361505289f15 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:13.622568 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-01c85ef6-8fe6-42aa-a5f8-1f1b156ca4a5 req-a0a5fd71-101d-40b0-bf03-361505289f15 service nova] Creating event network-vif-deleted:f26be1b1-f89b-4ad1-a594-75ab2eb8880b for instance 58a45214-041c-468c-858f-1a87859ecf20 on hv-cinder-85144 Aug 02 21:55:13.629594 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-01c85ef6-8fe6-42aa-a5f8-1f1b156ca4a5 req-a0a5fd71-101d-40b0-bf03-361505289f15 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034521 Aug 02 21:55:13.630198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 575/1123] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:55:13.659342 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bb3ffac4-0ec9-478a-b1ba-32722b30b3e3 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2557b90bba5c41be864a92fc49484a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:55:13.670285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bb3ffac4-0ec9-478a-b1ba-32722b30b3e3 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 200 len: 1473 microversion: 2.1 time: 0.098625 Aug 02 21:55:13.670881 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 549/1124] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:55:13 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 1473 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:55:14.691934 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:55:14.692665 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] [instance: 58a45214-041c-468c-858f-1a87859ecf20] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:55:14.699585 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:14.700030 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:14.700821 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:14.701257 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:14.716581 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.wsgi [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] HTTP exception thrown: Instance 58a45214-041c-468c-858f-1a87859ecf20 could not be found. Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Request method failure captured: Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: request: GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 HTTP/1.1 Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept: application/json Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Accept-Encoding: identity Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Connection: close Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Length: 0 Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Content-Type: application/json Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Host: 10.222.0.57 Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Openstack-System-Scope: None Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: User-Agent: python-urllib3/1.26.10 Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Auth-Token: gAAAAABi6ZzOz5f1SkAdbbF_BvIINAuiaFH3YTK1IYogj5qp7jftzX_QWfb-y8D9deBdTv20sEeIh_s2k1456ngSi4_jGqq7G985zF_K0uH-mfvFd90LQYb0Jm4ijSxDNCP9Zs_AYhYSFI13SbkJAyXoSl9sWWoJzoUJxO4Sn6njAs1Ugr7TPss Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Id: None Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Domain-Name: None Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Identity-Status: Confirmed Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Is-Admin-Project: True Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Id: default Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Domain-Name: Default Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Id: 7191ff82ccdb4ed78b592fc6f01bf9d3 Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Project-Name: tempest-VolumesSnapshotTestJSON-304085012 Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Role: member,reader Aug 02 21:55:14.718191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Roles: member,reader Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7191ff82ccdb4ed78b592fc6f01bf9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7191ff82ccdb4ed78b592fc6f01bf9d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7191ff82ccdb4ed78b592fc6f01bf9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7191ff82ccdb4ed78b592fc6f01bf9d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant: tempest-VolumesSnapshotTestJSON-304085012 Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Id: 7191ff82ccdb4ed78b592fc6f01bf9d3 Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-304085012 Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User: tempest-VolumesSnapshotTestJSON-304085012-project Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Id: default Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Domain-Name: Default Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Id: 2557b90bba5c41be864a92fc49484a3c Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: X-User-Name: tempest-VolumesSnapshotTestJSON-304085012-project Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: method: > Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: exception: Instance 58a45214-041c-468c-858f-1a87859ecf20 could not be found. Aug 02 21:55:14.719890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: action_args: {'id': '58a45214-041c-468c-858f-1a87859ecf20'} Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a45214-041c-468c-858f-1a87859ecf20 could not be found. Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:55:14.720884 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a45214-041c-468c-858f-1a87859ecf20 could not be found. Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a45214-041c-468c-858f-1a87859ecf20 could not be found. Aug 02 21:55:14.722469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR nova.api.openstack.wsgi Aug 02 21:55:14.723865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] Returning 404 to user: Instance 58a45214-041c-468c-858f-1a87859ecf20 could not be found. {{(pid=124839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:55:14.723865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7bc9447e-95e8-475f-af48-f05ce3d917c1 tempest-VolumesSnapshotTestJSON-304085012 tempest-VolumesSnapshotTestJSON-304085012-project] 10.222.0.57 "GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20" status: 404 len: 111 microversion: 2.1 time: 0.032092 Aug 02 21:55:14.723865 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 576/1125] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:55:14 2022] GET /compute/v2.1/servers/58a45214-041c-468c-858f-1a87859ecf20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:55:59.099968 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-64a2cac0-5ace-4cd5-8c10-5ce383039e22 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Action: 'create', calling method: .version_select at 0x7ff55806cdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1659276821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7mFJKyLOnX4rgpd9N8XlPF2GhomV9MXi32x6pJD7dZ6B3zhEmix7z7QcnnzUSCwygLcYl/aWUM0F6nKaPCw3TvyHP1kzpYt3Gfu7ywoxx0ceXCxEFky1Y7qc/Aayu4zg=="}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:55:59.105595 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=6 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:59.106261 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:59.118772 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-64a2cac0-5ace-4cd5-8c10-5ce383039e22 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Getting quotas for project 22deaa4824874516b11d615beab8392e. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:55:59.122577 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.quota [None req-64a2cac0-5ace-4cd5-8c10-5ce383039e22 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Getting quotas for user 52420cdbbfed4bfd97c6e5010cb21e07 and project 22deaa4824874516b11d615beab8392e. Resources: {'key_pairs'} {{(pid=124840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:55:59.144633 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-64a2cac0-5ace-4cd5-8c10-5ce383039e22 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048820 Aug 02 21:55:59.145233 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 550/1126] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 2 21:55:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:55:59.195464 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-60461266", "imageRef": "70b4eb70-559b-4330-aa8e-487812652c1d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1659276821", "networks": [{"uuid": "b886e05a-bd4f-4126-9210-4272da787138"}]}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:55:59.204228 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:59.204883 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:59.250244 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.network.neutron [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] validate_networks() for [('b886e05a-bd4f-4126-9210-4272da787138', None, None, None, None, None)] {{(pid=124839) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 21:55:59.616720 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Flavor limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 21:55:59.617155 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Image limits 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 21:55:59.618230 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Flavor pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 21:55:59.618646 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Image pref 0:0:0 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 21:55:59.619064 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.virt.hardware [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 21:55:59.629065 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:59.629570 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:59.630359 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:55:59.630796 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:55:59.647156 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Getting quotas for project 22deaa4824874516b11d615beab8392e. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 21:55:59.651028 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.quota [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Getting quotas for user 52420cdbbfed4bfd97c6e5010cb21e07 and project 22deaa4824874516b11d615beab8392e. Resources: {'cores', 'instances', 'ram'} {{(pid=124839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 21:55:59.661868 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Going to run 1 instances... {{(pid=124839) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 21:55:59.664036 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70b4eb70-559b-4330-aa8e-487812652c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 21:55:59.709300 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b6c1474d-e4f6-4d16-ab8a-644d6e45dd29 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517763 Aug 02 21:55:59.709927 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 577/1127] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 2 21:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 21:55:59.720578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9927155d-2623-4038-a955-af3e38329198 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:55:59.721199 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9927155d-2623-4038-a955-af3e38329198 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:55:59.781002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-9927155d-2623-4038-a955-af3e38329198 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:55:59.791932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9927155d-2623-4038-a955-af3e38329198 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1257 microversion: 2.1 time: 0.075161 Aug 02 21:55:59.792568 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 551/1128] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:55:59 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:00.819330 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-989e62d6-2546-4658-b9fe-0310018b3e95 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:00.819964 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-989e62d6-2546-4658-b9fe-0310018b3e95 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:00.829836 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-989e62d6-2546-4658-b9fe-0310018b3e95 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:00.830576 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-989e62d6-2546-4658-b9fe-0310018b3e95 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:00.831467 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-989e62d6-2546-4658-b9fe-0310018b3e95 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:00.832010 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-989e62d6-2546-4658-b9fe-0310018b3e95 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:00.904652 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-989e62d6-2546-4658-b9fe-0310018b3e95 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:00.912273 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-989e62d6-2546-4658-b9fe-0310018b3e95 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1315 microversion: 2.1 time: 0.100772 Aug 02 21:56:00.912835 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 578/1129] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:00 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1315 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:01.933939 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-4f22c79a-a948-4bf9-9d34-358ea9719127 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:01.934501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-4f22c79a-a948-4bf9-9d34-358ea9719127 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:01.941268 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f22c79a-a948-4bf9-9d34-358ea9719127 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:01.941731 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f22c79a-a948-4bf9-9d34-358ea9719127 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:01.942615 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f22c79a-a948-4bf9-9d34-358ea9719127 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:01.943050 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-4f22c79a-a948-4bf9-9d34-358ea9719127 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:02.083603 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-4f22c79a-a948-4bf9-9d34-358ea9719127 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:02.092001 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-4f22c79a-a948-4bf9-9d34-358ea9719127 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.162163 Aug 02 21:56:02.092637 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 552/1130] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:01 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:03.115382 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-df72cfae-6cda-4e8d-97ae-8008e5c81c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:03.116028 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-df72cfae-6cda-4e8d-97ae-8008e5c81c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:03.123035 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-df72cfae-6cda-4e8d-97ae-8008e5c81c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:03.123768 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-df72cfae-6cda-4e8d-97ae-8008e5c81c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:03.124823 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-df72cfae-6cda-4e8d-97ae-8008e5c81c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:03.126079 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-df72cfae-6cda-4e8d-97ae-8008e5c81c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:03.268556 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-df72cfae-6cda-4e8d-97ae-8008e5c81c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:03.277361 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-df72cfae-6cda-4e8d-97ae-8008e5c81c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.166006 Aug 02 21:56:03.278276 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 579/1131] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:03 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:04.298745 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-61657696-a2fb-4990-b5aa-10a7885e51bc tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:04.299360 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-61657696-a2fb-4990-b5aa-10a7885e51bc tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:04.306045 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-61657696-a2fb-4990-b5aa-10a7885e51bc tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:04.306503 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-61657696-a2fb-4990-b5aa-10a7885e51bc tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:04.307290 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-61657696-a2fb-4990-b5aa-10a7885e51bc tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:04.307735 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-61657696-a2fb-4990-b5aa-10a7885e51bc tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:04.454851 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-61657696-a2fb-4990-b5aa-10a7885e51bc tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:04.462715 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-61657696-a2fb-4990-b5aa-10a7885e51bc tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.167880 Aug 02 21:56:04.463296 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 553/1132] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:04 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:05.484760 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-77b55f25-529b-479c-a189-454e87f23432 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:05.485327 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-77b55f25-529b-479c-a189-454e87f23432 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:05.492062 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-77b55f25-529b-479c-a189-454e87f23432 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:05.492591 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-77b55f25-529b-479c-a189-454e87f23432 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:05.493392 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-77b55f25-529b-479c-a189-454e87f23432 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:05.493838 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-77b55f25-529b-479c-a189-454e87f23432 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:05.660771 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-77b55f25-529b-479c-a189-454e87f23432 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:05.676433 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-77b55f25-529b-479c-a189-454e87f23432 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.195869 Aug 02 21:56:05.677666 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 580/1133] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:05 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:06.699300 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-27f3505c-508c-4a04-a742-b84ae09df724 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:06.700002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-27f3505c-508c-4a04-a742-b84ae09df724 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:06.707801 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-27f3505c-508c-4a04-a742-b84ae09df724 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:06.708293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-27f3505c-508c-4a04-a742-b84ae09df724 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:06.709079 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-27f3505c-508c-4a04-a742-b84ae09df724 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:06.709722 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-27f3505c-508c-4a04-a742-b84ae09df724 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:06.856669 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-27f3505c-508c-4a04-a742-b84ae09df724 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:06.864909 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-27f3505c-508c-4a04-a742-b84ae09df724 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.170190 Aug 02 21:56:06.866470 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 554/1134] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:06 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:07.887686 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-30cf749c-ca88-486b-88f7-91a2dc1c72ca tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:07.888390 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-30cf749c-ca88-486b-88f7-91a2dc1c72ca tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:07.895542 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-30cf749c-ca88-486b-88f7-91a2dc1c72ca tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:07.896114 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-30cf749c-ca88-486b-88f7-91a2dc1c72ca tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:07.897128 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-30cf749c-ca88-486b-88f7-91a2dc1c72ca tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:07.897577 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-30cf749c-ca88-486b-88f7-91a2dc1c72ca tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:08.057061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-30cf749c-ca88-486b-88f7-91a2dc1c72ca tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:08.071709 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-30cf749c-ca88-486b-88f7-91a2dc1c72ca tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.188562 Aug 02 21:56:08.072616 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 581/1135] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:07 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:09.095203 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7bb4e67f-150b-4539-91cf-3f85f5800db0 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:09.095807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7bb4e67f-150b-4539-91cf-3f85f5800db0 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:09.103222 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7bb4e67f-150b-4539-91cf-3f85f5800db0 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:09.103689 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7bb4e67f-150b-4539-91cf-3f85f5800db0 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:09.104522 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7bb4e67f-150b-4539-91cf-3f85f5800db0 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:09.104968 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7bb4e67f-150b-4539-91cf-3f85f5800db0 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:09.250224 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7bb4e67f-150b-4539-91cf-3f85f5800db0 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:09.258811 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7bb4e67f-150b-4539-91cf-3f85f5800db0 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.167084 Aug 02 21:56:09.259416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 555/1136] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:09 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:10.279144 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-b5a169f7-ba34-4cfb-9718-b32de465a778 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:10.279772 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-b5a169f7-ba34-4cfb-9718-b32de465a778 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:10.282183 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=2 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:10.282890 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell0:SELECT=6 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:10.288969 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b5a169f7-ba34-4cfb-9718-b32de465a778 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:10.289933 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b5a169f7-ba34-4cfb-9718-b32de465a778 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:10.290725 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b5a169f7-ba34-4cfb-9718-b32de465a778 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:10.291173 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-b5a169f7-ba34-4cfb-9718-b32de465a778 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:10.419782 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-b5a169f7-ba34-4cfb-9718-b32de465a778 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:10.427476 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-b5a169f7-ba34-4cfb-9718-b32de465a778 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.152406 Aug 02 21:56:10.428047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 582/1137] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:10 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:11.448943 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-b8c0d5c2-4040-4f7d-b1cf-2bd097da7fa7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:11.449510 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-b8c0d5c2-4040-4f7d-b1cf-2bd097da7fa7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:11.451478 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=6 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:11.456875 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b8c0d5c2-4040-4f7d-b1cf-2bd097da7fa7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:11.457327 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b8c0d5c2-4040-4f7d-b1cf-2bd097da7fa7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:11.458093 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b8c0d5c2-4040-4f7d-b1cf-2bd097da7fa7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:11.458530 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-b8c0d5c2-4040-4f7d-b1cf-2bd097da7fa7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:11.588347 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-b8c0d5c2-4040-4f7d-b1cf-2bd097da7fa7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:11.596807 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-b8c0d5c2-4040-4f7d-b1cf-2bd097da7fa7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.152347 Aug 02 21:56:11.599673 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 556/1138] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:11 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:12.443614 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-dae319c4-fc7f-48c3-974f-03457735129d req-f1109a96-a89b-4ba9-9520-b91b7e212241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273a7612-066a-449a-b477-2ee28d56d7cd", "tag": "3710fd5c-9f7d-4769-88ca-2f5f200090c0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:56:12.456124 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-dae319c4-fc7f-48c3-974f-03457735129d req-f1109a96-a89b-4ba9-9520-b91b7e212241 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:12.456615 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-dae319c4-fc7f-48c3-974f-03457735129d req-f1109a96-a89b-4ba9-9520-b91b7e212241 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:12.468520 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-dae319c4-fc7f-48c3-974f-03457735129d req-f1109a96-a89b-4ba9-9520-b91b7e212241 service nova] Creating event network-changed:3710fd5c-9f7d-4769-88ca-2f5f200090c0 for instance 273a7612-066a-449a-b477-2ee28d56d7cd on hv-cinder-85144 Aug 02 21:56:12.474363 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-dae319c4-fc7f-48c3-974f-03457735129d req-f1109a96-a89b-4ba9-9520-b91b7e212241 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035452 Aug 02 21:56:12.475516 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 583/1139] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:56:12.625144 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-5e6de2d4-2423-4eac-a3e2-678b264787e4 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:12.625862 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-5e6de2d4-2423-4eac-a3e2-678b264787e4 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:12.632621 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e6de2d4-2423-4eac-a3e2-678b264787e4 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:12.633740 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e6de2d4-2423-4eac-a3e2-678b264787e4 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:12.634518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e6de2d4-2423-4eac-a3e2-678b264787e4 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:12.634957 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-5e6de2d4-2423-4eac-a3e2-678b264787e4 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:12.832764 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-5e6de2d4-2423-4eac-a3e2-678b264787e4 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:12.840221 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-5e6de2d4-2423-4eac-a3e2-678b264787e4 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.219000 Aug 02 21:56:12.840796 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 557/1140] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:12 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:13.861673 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-4701537d-d1ac-46b3-8905-88323db0f3ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:13.862379 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-4701537d-d1ac-46b3-8905-88323db0f3ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:13.869047 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4701537d-d1ac-46b3-8905-88323db0f3ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:13.869499 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4701537d-d1ac-46b3-8905-88323db0f3ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:13.870261 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4701537d-d1ac-46b3-8905-88323db0f3ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:13.870699 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-4701537d-d1ac-46b3-8905-88323db0f3ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:14.016417 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-4701537d-d1ac-46b3-8905-88323db0f3ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:14.024451 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-4701537d-d1ac-46b3-8905-88323db0f3ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.166433 Aug 02 21:56:14.025061 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 584/1141] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:13 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:15.045578 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-6d2d2b7c-20e5-4ae7-87c1-1c76c3c08c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:15.046201 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-6d2d2b7c-20e5-4ae7-87c1-1c76c3c08c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:15.052758 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6d2d2b7c-20e5-4ae7-87c1-1c76c3c08c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:15.053163 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6d2d2b7c-20e5-4ae7-87c1-1c76c3c08c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:15.053946 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6d2d2b7c-20e5-4ae7-87c1-1c76c3c08c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:15.054397 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-6d2d2b7c-20e5-4ae7-87c1-1c76c3c08c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:15.279340 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-6d2d2b7c-20e5-4ae7-87c1-1c76c3c08c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:15.288042 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-6d2d2b7c-20e5-4ae7-87c1-1c76c3c08c5b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.246373 Aug 02 21:56:15.289264 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 558/1142] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:15 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:16.310255 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-3e9c27dd-9474-4daa-b444-d5cd96244529 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:16.310880 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-3e9c27dd-9474-4daa-b444-d5cd96244529 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:16.317502 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e9c27dd-9474-4daa-b444-d5cd96244529 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:16.317962 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e9c27dd-9474-4daa-b444-d5cd96244529 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:16.318741 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e9c27dd-9474-4daa-b444-d5cd96244529 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:16.319189 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-3e9c27dd-9474-4daa-b444-d5cd96244529 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:16.451919 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-3e9c27dd-9474-4daa-b444-d5cd96244529 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:16.459511 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-3e9c27dd-9474-4daa-b444-d5cd96244529 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.153137 Aug 02 21:56:16.460081 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 585/1143] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:16 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:56:17.480776 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-c380ad3e-a2f7-465f-b742-caaba454e56c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:17.481399 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-c380ad3e-a2f7-465f-b742-caaba454e56c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:17.487930 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c380ad3e-a2f7-465f-b742-caaba454e56c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:17.488419 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c380ad3e-a2f7-465f-b742-caaba454e56c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:17.489193 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c380ad3e-a2f7-465f-b742-caaba454e56c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:17.489733 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-c380ad3e-a2f7-465f-b742-caaba454e56c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:17.618037 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-c380ad3e-a2f7-465f-b742-caaba454e56c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:17.625501 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-c380ad3e-a2f7-465f-b742-caaba454e56c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.149177 Aug 02 21:56:17.626069 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 559/1144] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:17 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:18.167033 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-493bd085-067c-432a-a786-7ec37a73d593 req-b3a7c47a-5a34-46fe-9304-52f8ea59b30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273a7612-066a-449a-b477-2ee28d56d7cd", "name": "network-vif-plugged", "status": "completed", "tag": "3710fd5c-9f7d-4769-88ca-2f5f200090c0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:56:18.177351 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-493bd085-067c-432a-a786-7ec37a73d593 req-b3a7c47a-5a34-46fe-9304-52f8ea59b30a service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:18.177805 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-493bd085-067c-432a-a786-7ec37a73d593 req-b3a7c47a-5a34-46fe-9304-52f8ea59b30a service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:18.189056 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-493bd085-067c-432a-a786-7ec37a73d593 req-b3a7c47a-5a34-46fe-9304-52f8ea59b30a service nova] Creating event network-vif-plugged:3710fd5c-9f7d-4769-88ca-2f5f200090c0 for instance 273a7612-066a-449a-b477-2ee28d56d7cd on hv-cinder-85144 Aug 02 21:56:18.194040 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-493bd085-067c-432a-a786-7ec37a73d593 req-b3a7c47a-5a34-46fe-9304-52f8ea59b30a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Aug 02 21:56:18.194632 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 586/1145] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:56:18.646126 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-f7055ea1-becf-4f0f-94db-59a0be4107d5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:18.646834 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-f7055ea1-becf-4f0f-94db-59a0be4107d5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:18.653593 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f7055ea1-becf-4f0f-94db-59a0be4107d5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:18.654051 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f7055ea1-becf-4f0f-94db-59a0be4107d5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:18.654820 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f7055ea1-becf-4f0f-94db-59a0be4107d5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:18.655259 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-f7055ea1-becf-4f0f-94db-59a0be4107d5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:18.786078 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-f7055ea1-becf-4f0f-94db-59a0be4107d5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:18.793465 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-f7055ea1-becf-4f0f-94db-59a0be4107d5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.151277 Aug 02 21:56:18.794028 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 560/1146] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:18 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:19.814749 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-d93606f4-d733-4196-97cf-63e2f0ab1257 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:19.815453 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-d93606f4-d733-4196-97cf-63e2f0ab1257 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:19.822198 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d93606f4-d733-4196-97cf-63e2f0ab1257 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:19.822651 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d93606f4-d733-4196-97cf-63e2f0ab1257 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:19.823417 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d93606f4-d733-4196-97cf-63e2f0ab1257 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:19.823855 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-d93606f4-d733-4196-97cf-63e2f0ab1257 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:19.951210 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-d93606f4-d733-4196-97cf-63e2f0ab1257 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:19.958737 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-d93606f4-d733-4196-97cf-63e2f0ab1257 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1357 microversion: 2.1 time: 0.148658 Aug 02 21:56:19.959300 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 587/1147] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:19 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:20.980996 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-34a852d1-3d12-49a3-b14e-1916cb7cee3c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:20.981651 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-34a852d1-3d12-49a3-b14e-1916cb7cee3c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:20.988218 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-34a852d1-3d12-49a3-b14e-1916cb7cee3c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:20.988675 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-34a852d1-3d12-49a3-b14e-1916cb7cee3c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:20.989451 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-34a852d1-3d12-49a3-b14e-1916cb7cee3c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:20.989889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-34a852d1-3d12-49a3-b14e-1916cb7cee3c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:21.119048 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-34a852d1-3d12-49a3-b14e-1916cb7cee3c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:21.126508 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-34a852d1-3d12-49a3-b14e-1916cb7cee3c tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1547 microversion: 2.1 time: 0.150115 Aug 02 21:56:21.127073 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 561/1148] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:20 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:21.147775 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-dc34350a-c84c-49f8-b395-eade7e568cb7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:21.149253 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-dc34350a-c84c-49f8-b395-eade7e568cb7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:21.159876 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dc34350a-c84c-49f8-b395-eade7e568cb7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:21.160950 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dc34350a-c84c-49f8-b395-eade7e568cb7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:21.162354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dc34350a-c84c-49f8-b395-eade7e568cb7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:21.163120 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-dc34350a-c84c-49f8-b395-eade7e568cb7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:21.300867 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-dc34350a-c84c-49f8-b395-eade7e568cb7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:21.308920 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-dc34350a-c84c-49f8-b395-eade7e568cb7 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1547 microversion: 2.1 time: 0.165229 Aug 02 21:56:21.309491 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 588/1149] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:21 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:21.328893 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:21.333743 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:21.334515 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Searching by: {'deleted': False, 'project_id': '22deaa4824874516b11d615beab8392e'} {{(pid=124840) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 21:56:21.341833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:21.342293 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:21.343101 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:21.343545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:21.433600 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.multi_cell_list [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124840) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 21:56:21.527424 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-bcdaff6c-a3d5-40aa-870c-bf43da6237fa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.202311 Aug 02 21:56:21.528359 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 562/1150] 10.222.0.57 () {58 vars in 1125 bytes} [Tue Aug 2 21:56:21 2022] GET /compute/v2.1/servers => generated 341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:56:21.539350 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-ed107fb4-1be2-4bc6-bee4-2ab921c3887b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:21.540057 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-ed107fb4-1be2-4bc6-bee4-2ab921c3887b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:21.546231 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ed107fb4-1be2-4bc6-bee4-2ab921c3887b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:21.546680 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ed107fb4-1be2-4bc6-bee4-2ab921c3887b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:21.547447 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ed107fb4-1be2-4bc6-bee4-2ab921c3887b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:21.547891 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-ed107fb4-1be2-4bc6-bee4-2ab921c3887b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:21.688508 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-ed107fb4-1be2-4bc6-bee4-2ab921c3887b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:21.696779 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-ed107fb4-1be2-4bc6-bee4-2ab921c3887b tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1547 microversion: 2.1 time: 0.161208 Aug 02 21:56:21.697354 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 589/1151] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:21 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:23.278596 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-156c5d90-c722-44d2-8e5d-edbae41ec7a1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:56:23.280935 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-156c5d90-c722-44d2-8e5d-edbae41ec7a1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:23.287406 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-156c5d90-c722-44d2-8e5d-edbae41ec7a1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:23.287862 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-156c5d90-c722-44d2-8e5d-edbae41ec7a1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:23.288741 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-156c5d90-c722-44d2-8e5d-edbae41ec7a1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:23.289190 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-156c5d90-c722-44d2-8e5d-edbae41ec7a1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:23.564506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-156c5d90-c722-44d2-8e5d-edbae41ec7a1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "POST /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290036 Aug 02 21:56:23.565129 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 563/1152] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 2 21:56:23 2022] POST /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:56:31.157734 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-c4d11dcc-5d52-492c-b7c0-12c9c1555265 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:31.158357 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-c4d11dcc-5d52-492c-b7c0-12c9c1555265 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:31.161053 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:31.166634 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4d11dcc-5d52-492c-b7c0-12c9c1555265 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:31.167090 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4d11dcc-5d52-492c-b7c0-12c9c1555265 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:31.167871 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4d11dcc-5d52-492c-b7c0-12c9c1555265 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:31.168350 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-c4d11dcc-5d52-492c-b7c0-12c9c1555265 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:31.172029 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=67 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:31.557632 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-c4d11dcc-5d52-492c-b7c0-12c9c1555265 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:31.565629 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-c4d11dcc-5d52-492c-b7c0-12c9c1555265 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1593 microversion: 2.1 time: 0.411776 Aug 02 21:56:31.566194 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 590/1153] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:31 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1593 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:56:33.238387 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell0:SELECT=2 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:33.245100 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-db7f2105-8167-4ee6-9fc1-3fc83344b27d req-153db6dc-d734-4284-a91c-cb7362860fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273a7612-066a-449a-b477-2ee28d56d7cd", "tag": "3710fd5c-9f7d-4769-88ca-2f5f200090c0"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:56:33.250902 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:33.258694 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-db7f2105-8167-4ee6-9fc1-3fc83344b27d req-153db6dc-d734-4284-a91c-cb7362860fa1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:33.259240 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-db7f2105-8167-4ee6-9fc1-3fc83344b27d req-153db6dc-d734-4284-a91c-cb7362860fa1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:33.262481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:33.274936 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-db7f2105-8167-4ee6-9fc1-3fc83344b27d req-153db6dc-d734-4284-a91c-cb7362860fa1 service nova] Creating event network-changed:3710fd5c-9f7d-4769-88ca-2f5f200090c0 for instance 273a7612-066a-449a-b477-2ee28d56d7cd on hv-cinder-85144 Aug 02 21:56:33.280748 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-db7f2105-8167-4ee6-9fc1-3fc83344b27d req-153db6dc-d734-4284-a91c-cb7362860fa1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043755 Aug 02 21:56:33.281634 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 564/1154] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:56:34.268587 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-51024f19-7fc1-476a-b789-70569d64aea9 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-402374350"}} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:56:34.269119 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-51024f19-7fc1-476a-b789-70569d64aea9 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:34.275463 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-51024f19-7fc1-476a-b789-70569d64aea9 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:34.275919 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-51024f19-7fc1-476a-b789-70569d64aea9 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:34.276733 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-51024f19-7fc1-476a-b789-70569d64aea9 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:34.277175 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-51024f19-7fc1-476a-b789-70569d64aea9 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:34.408355 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.network.security_group_api [None req-51024f19-7fc1-476a-b789-70569d64aea9 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Adding security group b64dae47-ba0d-4bfd-9ca2-c450a6aaf965 to port 3710fd5c-9f7d-4769-88ca-2f5f200090c0 Aug 02 21:56:34.742052 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-51024f19-7fc1-476a-b789-70569d64aea9 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "POST /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/action" status: 202 len: 0 microversion: 2.1 time: 0.476632 Aug 02 21:56:34.742881 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 591/1155] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:56:34 2022] POST /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 21:56:34.750264 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-b68faeff-4c33-4367-8790-ad882f4f7db9 req-2ecc89dd-05c2-4548-a18e-3f1e7b74bdfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273a7612-066a-449a-b477-2ee28d56d7cd", "tag": "3710fd5c-9f7d-4769-88ca-2f5f200090c0"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:56:34.752531 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8f8ba6d2-a0f8-4281-9a89-5b21dbc1f9ff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:56:34.753393 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8f8ba6d2-a0f8-4281-9a89-5b21dbc1f9ff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:56:34.761297 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8f8ba6d2-a0f8-4281-9a89-5b21dbc1f9ff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:34.762226 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8f8ba6d2-a0f8-4281-9a89-5b21dbc1f9ff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:34.763041 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-b68faeff-4c33-4367-8790-ad882f4f7db9 req-2ecc89dd-05c2-4548-a18e-3f1e7b74bdfa service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:34.763257 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8f8ba6d2-a0f8-4281-9a89-5b21dbc1f9ff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:56:34.763490 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-b68faeff-4c33-4367-8790-ad882f4f7db9 req-2ecc89dd-05c2-4548-a18e-3f1e7b74bdfa service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:34.764552 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8f8ba6d2-a0f8-4281-9a89-5b21dbc1f9ff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:56:34.776433 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-b68faeff-4c33-4367-8790-ad882f4f7db9 req-2ecc89dd-05c2-4548-a18e-3f1e7b74bdfa service nova] Creating event network-changed:3710fd5c-9f7d-4769-88ca-2f5f200090c0 for instance 273a7612-066a-449a-b477-2ee28d56d7cd on hv-cinder-85144 Aug 02 21:56:34.782018 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-b68faeff-4c33-4367-8790-ad882f4f7db9 req-2ecc89dd-05c2-4548-a18e-3f1e7b74bdfa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037519 Aug 02 21:56:34.783002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 565/1156] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:56:35.018562 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8f8ba6d2-a0f8-4281-9a89-5b21dbc1f9ff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:56:35.029733 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8f8ba6d2-a0f8-4281-9a89-5b21dbc1f9ff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1758 microversion: 2.1 time: 0.282704 Aug 02 21:56:35.030798 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 592/1157] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:56:34 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1758 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 21:56:53.103676 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 21:56:53.104322 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Tue Aug 2 21:56:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 21:56:55.215545 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 21:56:55.216106 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Tue Aug 2 21:56:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 21:57:33.795510 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-3e1d0db6-190f-467f-902b-0d76d2962330 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:57:33.797889 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-3e1d0db6-190f-467f-902b-0d76d2962330 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:33.799898 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:57:33.800587 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=3 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:57:33.807034 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3e1d0db6-190f-467f-902b-0d76d2962330 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:33.807490 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3e1d0db6-190f-467f-902b-0d76d2962330 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:33.808322 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3e1d0db6-190f-467f-902b-0d76d2962330 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:33.809404 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-3e1d0db6-190f-467f-902b-0d76d2962330 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:33.881518 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-3e1d0db6-190f-467f-902b-0d76d2962330 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "POST /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/action" status: 202 len: 0 microversion: 2.1 time: 0.089588 Aug 02 21:57:33.882132 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 566/1158] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:57:33 2022] POST /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:57:33.891522 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-11201533-14dc-4301-80f4-d2220de44d1e tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:33.892200 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-11201533-14dc-4301-80f4-d2220de44d1e tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:33.894172 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=5 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:57:33.894834 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=15 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:57:33.903461 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-11201533-14dc-4301-80f4-d2220de44d1e tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:33.903918 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-11201533-14dc-4301-80f4-d2220de44d1e tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:33.904741 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-11201533-14dc-4301-80f4-d2220de44d1e tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:33.905186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-11201533-14dc-4301-80f4-d2220de44d1e tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:34.050384 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-11201533-14dc-4301-80f4-d2220de44d1e tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:34.058864 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-11201533-14dc-4301-80f4-d2220de44d1e tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1750 microversion: 2.1 time: 0.171896 Aug 02 21:57:34.059469 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 593/1159] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:33 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:35.082899 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-efab10be-6f2a-499d-9a4a-1b77ab75f5aa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:35.084353 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-efab10be-6f2a-499d-9a4a-1b77ab75f5aa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:35.097099 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-efab10be-6f2a-499d-9a4a-1b77ab75f5aa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:35.097541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-efab10be-6f2a-499d-9a4a-1b77ab75f5aa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:35.098338 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-efab10be-6f2a-499d-9a4a-1b77ab75f5aa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:35.098778 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-efab10be-6f2a-499d-9a4a-1b77ab75f5aa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:35.254799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-efab10be-6f2a-499d-9a4a-1b77ab75f5aa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:35.262878 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-efab10be-6f2a-499d-9a4a-1b77ab75f5aa tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.185245 Aug 02 21:57:35.263457 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 567/1160] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:35 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:36.285040 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-07761e64-f592-401e-87e4-da4537adbc3a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:36.285640 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-07761e64-f592-401e-87e4-da4537adbc3a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:36.292910 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-07761e64-f592-401e-87e4-da4537adbc3a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:36.293370 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-07761e64-f592-401e-87e4-da4537adbc3a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:36.294145 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-07761e64-f592-401e-87e4-da4537adbc3a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:36.294587 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-07761e64-f592-401e-87e4-da4537adbc3a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:36.447220 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-07761e64-f592-401e-87e4-da4537adbc3a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:36.456222 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-07761e64-f592-401e-87e4-da4537adbc3a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.174703 Aug 02 21:57:36.457191 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 594/1161] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:36 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:37.484833 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-2ac24946-4b2a-4a19-b187-3831e27c649d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:37.485440 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-2ac24946-4b2a-4a19-b187-3831e27c649d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:37.491896 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ac24946-4b2a-4a19-b187-3831e27c649d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:37.492380 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ac24946-4b2a-4a19-b187-3831e27c649d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:37.493162 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ac24946-4b2a-4a19-b187-3831e27c649d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:37.493599 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-2ac24946-4b2a-4a19-b187-3831e27c649d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:37.636514 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-2ac24946-4b2a-4a19-b187-3831e27c649d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:37.644454 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-2ac24946-4b2a-4a19-b187-3831e27c649d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.163579 Aug 02 21:57:37.645018 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 568/1162] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:37 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:38.666564 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-08e810dd-9042-406e-a8c4-3c69c3952640 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:38.667152 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-08e810dd-9042-406e-a8c4-3c69c3952640 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:38.673579 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-08e810dd-9042-406e-a8c4-3c69c3952640 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:38.674025 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-08e810dd-9042-406e-a8c4-3c69c3952640 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:38.674783 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-08e810dd-9042-406e-a8c4-3c69c3952640 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:38.675218 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-08e810dd-9042-406e-a8c4-3c69c3952640 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:38.817678 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-08e810dd-9042-406e-a8c4-3c69c3952640 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:38.825695 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-08e810dd-9042-406e-a8c4-3c69c3952640 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.163014 Aug 02 21:57:38.826215 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 595/1163] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:38 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:39.847555 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e684688f-ab33-475b-a4da-26294347ee79 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:39.848192 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e684688f-ab33-475b-a4da-26294347ee79 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:39.854845 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e684688f-ab33-475b-a4da-26294347ee79 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:39.855299 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e684688f-ab33-475b-a4da-26294347ee79 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:39.856070 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e684688f-ab33-475b-a4da-26294347ee79 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:39.856538 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e684688f-ab33-475b-a4da-26294347ee79 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:40.001283 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-e684688f-ab33-475b-a4da-26294347ee79 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:40.009502 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e684688f-ab33-475b-a4da-26294347ee79 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.165987 Aug 02 21:57:40.010071 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 569/1164] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:39 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:41.031307 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-bff14963-ad25-487f-8946-ee52b3c64490 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:41.031954 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-bff14963-ad25-487f-8946-ee52b3c64490 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:41.038895 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bff14963-ad25-487f-8946-ee52b3c64490 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:41.039353 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bff14963-ad25-487f-8946-ee52b3c64490 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:41.040158 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bff14963-ad25-487f-8946-ee52b3c64490 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:41.040599 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-bff14963-ad25-487f-8946-ee52b3c64490 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:41.187275 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-bff14963-ad25-487f-8946-ee52b3c64490 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:41.196126 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-bff14963-ad25-487f-8946-ee52b3c64490 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.169038 Aug 02 21:57:41.196718 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 596/1165] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:41 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:42.217456 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7ef6fc9d-72e5-4bb9-8b1f-d075e1a5ff67 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:42.218005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7ef6fc9d-72e5-4bb9-8b1f-d075e1a5ff67 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:42.224882 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7ef6fc9d-72e5-4bb9-8b1f-d075e1a5ff67 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:42.225327 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7ef6fc9d-72e5-4bb9-8b1f-d075e1a5ff67 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:42.226087 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7ef6fc9d-72e5-4bb9-8b1f-d075e1a5ff67 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:42.226524 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7ef6fc9d-72e5-4bb9-8b1f-d075e1a5ff67 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:42.370984 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7ef6fc9d-72e5-4bb9-8b1f-d075e1a5ff67 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:42.379495 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7ef6fc9d-72e5-4bb9-8b1f-d075e1a5ff67 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.165985 Aug 02 21:57:42.380096 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 570/1166] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:42 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:43.410735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-5948f494-4ae7-4bf5-991e-06fc79e72486 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:43.411990 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-5948f494-4ae7-4bf5-991e-06fc79e72486 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:43.418541 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5948f494-4ae7-4bf5-991e-06fc79e72486 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:43.418999 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5948f494-4ae7-4bf5-991e-06fc79e72486 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:43.419770 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5948f494-4ae7-4bf5-991e-06fc79e72486 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:43.420235 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-5948f494-4ae7-4bf5-991e-06fc79e72486 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:43.583085 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-5948f494-4ae7-4bf5-991e-06fc79e72486 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:43.591186 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-5948f494-4ae7-4bf5-991e-06fc79e72486 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.184759 Aug 02 21:57:43.591750 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 597/1167] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:43 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:44.611915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-66464620-f748-4861-a793-f0f22031ba08 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:44.612509 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-66464620-f748-4861-a793-f0f22031ba08 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:44.619843 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66464620-f748-4861-a793-f0f22031ba08 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:44.620363 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66464620-f748-4861-a793-f0f22031ba08 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:44.621133 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66464620-f748-4861-a793-f0f22031ba08 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:44.621579 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-66464620-f748-4861-a793-f0f22031ba08 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:44.769195 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-66464620-f748-4861-a793-f0f22031ba08 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:44.777849 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-66464620-f748-4861-a793-f0f22031ba08 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1755 microversion: 2.1 time: 0.169905 Aug 02 21:57:44.778700 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 571/1168] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:44 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:57:45.799533 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-8b732918-4ffe-4d89-b3fb-635c73ab9867 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:57:45.800162 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-8b732918-4ffe-4d89-b3fb-635c73ab9867 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:57:45.807068 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8b732918-4ffe-4d89-b3fb-635c73ab9867 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:45.807530 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8b732918-4ffe-4d89-b3fb-635c73ab9867 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:45.808365 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8b732918-4ffe-4d89-b3fb-635c73ab9867 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:57:45.808817 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-8b732918-4ffe-4d89-b3fb-635c73ab9867 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:57:45.956828 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-8b732918-4ffe-4d89-b3fb-635c73ab9867 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:57:45.965612 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-8b732918-4ffe-4d89-b3fb-635c73ab9867 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1758 microversion: 2.1 time: 0.170027 Aug 02 21:57:45.966179 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 598/1169] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:57:45 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:58:29.053103 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 21:58:29.053692 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Tue Aug 2 21:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 21:58:34.087401 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-9d6a9808-fcf2-4932-894a-2f224d16e0e1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-402374350"}} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:58:34.088123 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-9d6a9808-fcf2-4932-894a-2f224d16e0e1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:34.090002 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_api:SELECT=12 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:58:34.090647 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG dbcounter [-] [124840] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:58:34.097084 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9d6a9808-fcf2-4932-894a-2f224d16e0e1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:34.097541 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9d6a9808-fcf2-4932-894a-2f224d16e0e1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:34.098331 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9d6a9808-fcf2-4932-894a-2f224d16e0e1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:34.098818 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-9d6a9808-fcf2-4932-894a-2f224d16e0e1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:34.233041 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.network.security_group_api [None req-9d6a9808-fcf2-4932-894a-2f224d16e0e1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Removing security group b64dae47-ba0d-4bfd-9ca2-c450a6aaf965 from port 3710fd5c-9f7d-4769-88ca-2f5f200090c0 Aug 02 21:58:34.784734 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-9d6a9808-fcf2-4932-894a-2f224d16e0e1 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "POST /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/action" status: 202 len: 0 microversion: 2.1 time: 0.702098 Aug 02 21:58:34.786116 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 572/1170] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 2 21:58:34 2022] POST /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 21:58:34.801529 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_api:SELECT=12 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:58:34.803205 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG dbcounter [-] [124839] Writing DB stats nova_cell1:SELECT=36 {{(pid=124839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:58:35.018163 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-9300778c-ba22-4068-8d7e-2a48c6a7a82d req-23b58f61-7a2b-4277-86a4-c48dd22419d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273a7612-066a-449a-b477-2ee28d56d7cd", "tag": "3710fd5c-9f7d-4769-88ca-2f5f200090c0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:58:35.032790 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-9300778c-ba22-4068-8d7e-2a48c6a7a82d req-23b58f61-7a2b-4277-86a4-c48dd22419d1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:35.033292 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-9300778c-ba22-4068-8d7e-2a48c6a7a82d req-23b58f61-7a2b-4277-86a4-c48dd22419d1 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:35.045995 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-9300778c-ba22-4068-8d7e-2a48c6a7a82d req-23b58f61-7a2b-4277-86a4-c48dd22419d1 service nova] Creating event network-changed:3710fd5c-9f7d-4769-88ca-2f5f200090c0 for instance 273a7612-066a-449a-b477-2ee28d56d7cd on hv-cinder-85144 Aug 02 21:58:35.050702 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: ERROR oslo.messaging._drivers.impl_rabbit [req-9300778c-ba22-4068-8d7e-2a48c6a7a82d req-23b58f61-7a2b-4277-86a4-c48dd22419d1 service nova] [819688d0-c584-4152-bddd-07693ba3e7a9] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 21:58:35.888268 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-ae4dff6f-9bdd-4edd-809f-0d7631aa4cb5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:35.888800 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-ae4dff6f-9bdd-4edd-809f-0d7631aa4cb5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:35.894861 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae4dff6f-9bdd-4edd-809f-0d7631aa4cb5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:35.895310 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae4dff6f-9bdd-4edd-809f-0d7631aa4cb5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:35.896154 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae4dff6f-9bdd-4edd-809f-0d7631aa4cb5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:35.896594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-ae4dff6f-9bdd-4edd-809f-0d7631aa4cb5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:35.979503 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.objects.instance [None req-ae4dff6f-9bdd-4edd-809f-0d7631aa4cb5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lazy-loading 'services' on Instance uuid 273a7612-066a-449a-b477-2ee28d56d7cd {{(pid=124840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 21:58:36.054719 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-ae4dff6f-9bdd-4edd-809f-0d7631aa4cb5 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "DELETE /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments/eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538" status: 202 len: 0 microversion: 2.1 time: 0.170747 Aug 02 21:58:36.055528 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 573/1171] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:58:35 2022] DELETE /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments/eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 21:58:36.062990 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO oslo.messaging._drivers.impl_rabbit [req-9300778c-ba22-4068-8d7e-2a48c6a7a82d req-23b58f61-7a2b-4277-86a4-c48dd22419d1 service nova] [819688d0-c584-4152-bddd-07693ba3e7a9] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48886. Aug 02 21:58:36.066996 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-9300778c-ba22-4068-8d7e-2a48c6a7a82d req-23b58f61-7a2b-4277-86a4-c48dd22419d1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.274810 Aug 02 21:58:36.070044 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-991b026a-6c27-4c21-972b-289ff1ff92f2 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:36.071561 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 599/1172] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:58:36.073466 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-991b026a-6c27-4c21-972b-289ff1ff92f2 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:36.081011 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-991b026a-6c27-4c21-972b-289ff1ff92f2 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:36.081474 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-991b026a-6c27-4c21-972b-289ff1ff92f2 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:36.082302 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-991b026a-6c27-4c21-972b-289ff1ff92f2 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:36.082747 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-991b026a-6c27-4c21-972b-289ff1ff92f2 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:36.129783 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-991b026a-6c27-4c21-972b-289ff1ff92f2 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066001 Aug 02 21:58:36.135005 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 574/1173] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:58:36 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 21:58:37.143748 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-7f8d6be6-c771-4e10-b99d-6348e84410d6 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:37.146218 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-7f8d6be6-c771-4e10-b99d-6348e84410d6 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:37.152674 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f8d6be6-c771-4e10-b99d-6348e84410d6 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:37.153126 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f8d6be6-c771-4e10-b99d-6348e84410d6 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:37.154165 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f8d6be6-c771-4e10-b99d-6348e84410d6 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:37.154608 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-7f8d6be6-c771-4e10-b99d-6348e84410d6 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:37.186551 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-7f8d6be6-c771-4e10-b99d-6348e84410d6 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047485 Aug 02 21:58:37.187129 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 600/1174] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 2 21:58:37 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 21:58:37.199500 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:37.200114 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:37.206419 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:37.206866 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:37.207737 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:37.208215 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:37.290232 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] HTTP exception thrown: Instance 273a7612-066a-449a-b477-2ee28d56d7cd is not attached to volume eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538 Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Request method failure captured: Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: DELETE /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments/eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538 HTTP/1.1 Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Z1htnmxJVQM7_JNhQRaYe0qgSayo3V7umQqjY1lFOK41iHxVqFJ9fQqMePHLP_V6uX3VPIeEi4j7MY1INpCCwOf0p7_YuB5CaTN9y_2M_EMSU4-12fLyP4xhfyCKU6nj1QC7iMUTJnE0EyIZ7jRj-NCdNWJ5tETMjJke9UObZ7omOM Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 22deaa4824874516b11d615beab8392e Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-TestMinimumBasicScenario-789142489 Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:58:37.292594 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/22deaa4824874516b11d615beab8392e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_22deaa4824874516b11d615beab8392e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/22deaa4824874516b11d615beab8392e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/22deaa4824874516b11d615beab8392e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-TestMinimumBasicScenario-789142489 Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 22deaa4824874516b11d615beab8392e Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-TestMinimumBasicScenario-789142489 Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-TestMinimumBasicScenario-789142489-project Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 52420cdbbfed4bfd97c6e5010cb21e07 Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-TestMinimumBasicScenario-789142489-project Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:58:37.294542 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 273a7612-066a-449a-b477-2ee28d56d7cd is not attached to volume eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538 Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'server_id': '273a7612-066a-449a-b477-2ee28d56d7cd', 'id': 'eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538'} Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538. Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:58:37.295506 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273a7612-066a-449a-b477-2ee28d56d7cd is not attached to volume eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538 Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273a7612-066a-449a-b477-2ee28d56d7cd is not attached to volume eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538 Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:37.297285 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Returning 404 to user: Instance 273a7612-066a-449a-b477-2ee28d56d7cd is not attached to volume eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538 {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:58:37.298679 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-e2b0d786-7d65-46d6-9744-af518e6d5d5d tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "DELETE /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments/eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538" status: 404 len: 154 microversion: 2.1 time: 0.099668 Aug 02 21:58:37.298679 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 575/1175] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 2 21:58:37 2022] DELETE /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd/os-volume_attachments/eabcfa03-a9a1-48bc-8ab2-7d3d43ab0538 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:58:37.726070 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 21:58:37.726299 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Tue Aug 2 21:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 21:58:38.083719 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [req-b702d511-75fb-4c46-a240-00ad810dfe57 req-bb504abf-2b28-4c26-817e-b21e53c87e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273a7612-066a-449a-b477-2ee28d56d7cd", "tag": "3710fd5c-9f7d-4769-88ca-2f5f200090c0"}]} {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:58:38.093834 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-b702d511-75fb-4c46-a240-00ad810dfe57 req-bb504abf-2b28-4c26-817e-b21e53c87e1c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:38.094712 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [req-b702d511-75fb-4c46-a240-00ad810dfe57 req-bb504abf-2b28-4c26-817e-b21e53c87e1c service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:38.111814 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.compute.server_external_events [req-b702d511-75fb-4c46-a240-00ad810dfe57 req-bb504abf-2b28-4c26-817e-b21e53c87e1c service nova] Creating event network-changed:3710fd5c-9f7d-4769-88ca-2f5f200090c0 for instance 273a7612-066a-449a-b477-2ee28d56d7cd on hv-cinder-85144 Aug 02 21:58:38.121308 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [req-b702d511-75fb-4c46-a240-00ad810dfe57 req-bb504abf-2b28-4c26-817e-b21e53c87e1c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042008 Aug 02 21:58:38.122538 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 601/1176] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:58:38.447220 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7abcb127-f295-494d-bb23-b2ddc2e8f14a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:38.448117 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7abcb127-f295-494d-bb23-b2ddc2e8f14a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:38.455915 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7abcb127-f295-494d-bb23-b2ddc2e8f14a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:38.456416 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7abcb127-f295-494d-bb23-b2ddc2e8f14a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:38.457205 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7abcb127-f295-494d-bb23-b2ddc2e8f14a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:38.458245 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7abcb127-f295-494d-bb23-b2ddc2e8f14a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:38.485630 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7abcb127-f295-494d-bb23-b2ddc2e8f14a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Going to try to terminate instance {{(pid=124840) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 21:58:38.571799 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7abcb127-f295-494d-bb23-b2ddc2e8f14a tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "DELETE /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 204 len: 0 microversion: 2.1 time: 0.128406 Aug 02 21:58:38.572447 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 576/1177] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 2 21:58:38 2022] DELETE /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 21:58:38.582146 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-a0167e2d-105b-41df-9ba5-b5208bc0c801 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:38.582896 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-a0167e2d-105b-41df-9ba5-b5208bc0c801 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:38.590247 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a0167e2d-105b-41df-9ba5-b5208bc0c801 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:38.590703 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a0167e2d-105b-41df-9ba5-b5208bc0c801 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:38.591500 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a0167e2d-105b-41df-9ba5-b5208bc0c801 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:38.591935 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-a0167e2d-105b-41df-9ba5-b5208bc0c801 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:38.728514 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-a0167e2d-105b-41df-9ba5-b5208bc0c801 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:58:38.736409 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-a0167e2d-105b-41df-9ba5-b5208bc0c801 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1553 microversion: 2.1 time: 0.158613 Aug 02 21:58:38.736984 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 602/1178] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:58:38 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:58:39.758543 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-7e9dc0af-5760-411a-ab07-f04754c1126f tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:39.759244 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-7e9dc0af-5760-411a-ab07-f04754c1126f tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:39.765512 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e9dc0af-5760-411a-ab07-f04754c1126f tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:39.765953 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e9dc0af-5760-411a-ab07-f04754c1126f tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:39.766713 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e9dc0af-5760-411a-ab07-f04754c1126f tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:39.767144 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-7e9dc0af-5760-411a-ab07-f04754c1126f tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:39.903712 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.policy [None req-7e9dc0af-5760-411a-ab07-f04754c1126f tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124840) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:58:39.911945 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-7e9dc0af-5760-411a-ab07-f04754c1126f tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1553 microversion: 2.1 time: 0.158136 Aug 02 21:58:39.912610 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 577/1179] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:58:39 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:58:40.934254 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1ebbf98a-c2f8-45ab-b4a9-3dde9b87b8ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:40.935029 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.compute.api [None req-1ebbf98a-c2f8-45ab-b4a9-3dde9b87b8ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124839) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:40.945024 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1ebbf98a-c2f8-45ab-b4a9-3dde9b87b8ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:40.945490 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1ebbf98a-c2f8-45ab-b4a9-3dde9b87b8ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:40.946288 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1ebbf98a-c2f8-45ab-b4a9-3dde9b87b8ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:40.946735 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG oslo_concurrency.lockutils [None req-1ebbf98a-c2f8-45ab-b4a9-3dde9b87b8ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:40.999292 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [req-26d77a91-daeb-4739-bed0-1f8650d596e1 req-fd9e08cc-6125-4ffa-8d9a-a530619d6f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273a7612-066a-449a-b477-2ee28d56d7cd", "name": "network-vif-deleted", "tag": "3710fd5c-9f7d-4769-88ca-2f5f200090c0"}]} {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 21:58:41.010459 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-26d77a91-daeb-4739-bed0-1f8650d596e1 req-fd9e08cc-6125-4ffa-8d9a-a530619d6f26 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:41.010917 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [req-26d77a91-daeb-4739-bed0-1f8650d596e1 req-fd9e08cc-6125-4ffa-8d9a-a530619d6f26 service nova] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:41.018474 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.policy [None req-1ebbf98a-c2f8-45ab-b4a9-3dde9b87b8ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52420cdbbfed4bfd97c6e5010cb21e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22deaa4824874516b11d615beab8392e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124839) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 21:58:41.023732 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.compute.server_external_events [req-26d77a91-daeb-4739-bed0-1f8650d596e1 req-fd9e08cc-6125-4ffa-8d9a-a530619d6f26 service nova] Creating event network-vif-deleted:3710fd5c-9f7d-4769-88ca-2f5f200090c0 for instance 273a7612-066a-449a-b477-2ee28d56d7cd on hv-cinder-85144 Aug 02 21:58:41.028809 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1ebbf98a-c2f8-45ab-b4a9-3dde9b87b8ac tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 200 len: 1511 microversion: 2.1 time: 0.097925 Aug 02 21:58:41.029527 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [req-26d77a91-daeb-4739-bed0-1f8650d596e1 req-fd9e08cc-6125-4ffa-8d9a-a530619d6f26 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035344 Aug 02 21:58:41.030144 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 578/1181] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 2 21:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 21:58:41.032306 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 603/1181] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:58:40 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 21:58:42.052105 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '>' {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:42.053328 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.compute.api [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] [instance: 273a7612-066a-449a-b477-2ee28d56d7cd] Fetching instance by UUID {{(pid=124840) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 21:58:42.059481 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:42.059932 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:42.060726 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 21:58:42.061169 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG oslo_concurrency.lockutils [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Lock "78522f80-8c08-462b-a516-27a7c611540e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 21:58:42.074348 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.wsgi [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] HTTP exception thrown: Instance 273a7612-066a-449a-b477-2ee28d56d7cd could not be found. Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Request method failure captured: Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: request: GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd HTTP/1.1 Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept: application/json Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Accept-Encoding: identity Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Connection: close Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Length: 0 Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Content-Type: application/json Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Host: 10.222.0.57 Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Openstack-System-Scope: None Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: User-Agent: python-urllib3/1.26.10 Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Auth-Token: gAAAAABi6Z1htnmxJVQM7_JNhQRaYe0qgSayo3V7umQqjY1lFOK41iHxVqFJ9fQqMePHLP_V6uX3VPIeEi4j7MY1INpCCwOf0p7_YuB5CaTN9y_2M_EMSU4-12fLyP4xhfyCKU6nj1QC7iMUTJnE0EyIZ7jRj-NCdNWJ5tETMjJke9UObZ7omOM Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Id: None Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Domain-Name: None Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Identity-Status: Confirmed Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Is-Admin-Project: True Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Id: default Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Domain-Name: Default Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Id: 22deaa4824874516b11d615beab8392e Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Project-Name: tempest-TestMinimumBasicScenario-789142489 Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Role: member,reader Aug 02 21:58:42.075948 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Roles: member,reader Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/22deaa4824874516b11d615beab8392e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_22deaa4824874516b11d615beab8392e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/22deaa4824874516b11d615beab8392e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/22deaa4824874516b11d615beab8392e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant: tempest-TestMinimumBasicScenario-789142489 Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Id: 22deaa4824874516b11d615beab8392e Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-Tenant-Name: tempest-TestMinimumBasicScenario-789142489 Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User: tempest-TestMinimumBasicScenario-789142489-project Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Id: default Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Domain-Name: Default Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Id: 52420cdbbfed4bfd97c6e5010cb21e07 Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: X-User-Name: tempest-TestMinimumBasicScenario-789142489-project Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: method: > Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: exception: Instance 273a7612-066a-449a-b477-2ee28d56d7cd could not be found. Aug 02 21:58:42.077720 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: action_args: {'id': '273a7612-066a-449a-b477-2ee28d56d7cd'} Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: {{(pid=124840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273a7612-066a-449a-b477-2ee28d56d7cd could not be found. Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 21:58:42.078765 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273a7612-066a-449a-b477-2ee28d56d7cd could not be found. Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273a7612-066a-449a-b477-2ee28d56d7cd could not be found. Aug 02 21:58:42.080295 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: ERROR nova.api.openstack.wsgi Aug 02 21:58:42.081754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: DEBUG nova.api.openstack.wsgi [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Returning 404 to user: Instance 273a7612-066a-449a-b477-2ee28d56d7cd could not be found. {{(pid=124840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 21:58:42.081754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO nova.api.openstack.requestlog [None req-47b92aaa-2c7b-44ce-a2eb-f63a9813b939 tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd" status: 404 len: 111 microversion: 2.1 time: 0.030220 Aug 02 21:58:42.081754 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: [pid: 124840|app: 0|req: 579/1182] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 2 21:58:42 2022] GET /compute/v2.1/servers/273a7612-066a-449a-b477-2ee28d56d7cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 21:58:42.086197 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: DEBUG nova.api.openstack.wsgi [None req-1b496b41-4331-4f74-b7f9-22a5881fcfff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] Calling method '.version_select at 0x7ff55b812ca0>' {{(pid=124839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 21:58:42.109174 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO nova.api.openstack.requestlog [None req-1b496b41-4331-4f74-b7f9-22a5881fcfff tempest-TestMinimumBasicScenario-789142489 tempest-TestMinimumBasicScenario-789142489-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1659276821" status: 202 len: 0 microversion: 2.1 time: 0.026789 Aug 02 21:58:42.109739 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: [pid: 124839|app: 0|req: 604/1183] 10.222.0.57 () {58 vars in 1272 bytes} [Tue Aug 2 21:58:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1659276821 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 22:00:15.226042 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 22:00:15.226656 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Tue Aug 2 22:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 22:01:49.061426 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 22:01:49.062228 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Tue Aug 2 22:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 22:01:53.115170 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 22:01:53.115738 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Tue Aug 2 22:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 22:01:57.735201 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 22:01:57.735856 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Tue Aug 2 22:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 22:03:35.233986 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 22:03:35.234620 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Tue Aug 2 22:03:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 22:03:50.784819 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 22:03:50.785477 dv-cinder-851449-4-iscsi devstack@n-api.service[124839]: Tue Aug 2 22:03:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 22:03:52.730029 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 22:03:52.730589 dv-cinder-851449-4-iscsi devstack@n-api.service[124840]: Tue Aug 2 22:03:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!